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Abstract 

We study utility maximization for power utility random fields with 
and without intermediate consumption in a general semimartingale 
model with closed portfolio constraints. We show that any optimal 
strategy leads to a solution of the corresponding Bellman equation. 
The optimal strategies are described pointwise in terms of the oppor- 
tunity process, which is characterized as the minimal solution of the 
Bellman equation. We also give verification theorems for this equation. 
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1 Introduction 

A classical problem of mathematical finance is the maximization of expected 
utility obtained from consumption or from terminal wealth. This paper fo- 
cuses on power utility functions and presents the corresponding dynamic 
programming in a general constrained semimartingale framework. The ho- 
mogeneity of these utility functions leads to a factorization of the value 
process into a part depending on the current wealth and the so-called oppor- 
tunity process L. In our setting, the Bellman equation describes the drift 
rate of L and clarifies the local structure of our problem. Finding an optimal 
strategy boils down to maximizing a random function y i— > g(co, t, y) on M. d 
for every state uj and date t. This function is given in terms of the semi- 
martingale characteristics of L as well as the asset returns, and its maximum 
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yields the drift rate of L. The role of the opportunity process is to augment 
the information contained in the return characteristics in order to have a 
local sufficient statistic for the global optimization problem. 

We present three main results. First, we show that if there exists an 
optimal strategy for the utility maximization problem, the opportunity pro- 
cess L solves the Bellman equation and we provide a local description of the 
optimal strategies. We state the Bellman equation in two forms, as an iden- 
tity for the drift rate of L and as a backward stochastic differential equation 
(BSDE) for L. Second, we characterize the opportunity process as the mini- 
mal solution of this equation. Finally, given some solution and an associated 
strategy, one can ask whether the strategy is optimal and the solution is 
the opportunity process. We present two different approaches which lead to 
verification theorems not comparable in strength unless the constraints are 
convex. 

The present dynamic programming approach should be seen as comple- 
mentary to convex duality, which remains the only method to obtain exis- 
tence of optimal strategies in general models; see Kramkov and Schacher- 
mayer |21| . Karatzas and Zitkovic [20], Karatzas and Kardaras |19j . How- 
ever, convex duality alone offers limited insight into the optimal strategies 
for incomplete markets. In some cases, the Bellman equation can be solved 
directly by analytic methods; e.g., in the setting of Example 15.81 with con- 
tinuous asset prices or in the Levy process setting of Nutz |25j . In addition 
to the existence, one then obtains a way to compute the optimal strategies 
(at least numerically) and study their properties. 

This paper is organized as follows. The next section specifies the opti- 
mization problem in detail, recalls the opportunity process and the martin- 
gale optimality principle, and fixes the notation for the characteristics. We 
also introduce set-valued processes describing the budget condition and state 
the assumptions on the portfolio constraints. Section [3] derives the Bellman 
equation, first as a drift condition and then as a BSDE. It becomes more ex- 
plicit as we specialize to the case of continuous asset prices. The definition of 
a solution of the Bellman equation is given in Section [4j where we show the 
minimality of the opportunity process. Section [5] deals with the verification 
problem, which is converse to the derivation of the Bellman equation since 
it requires the passage from the local maximization to the global optimiza- 
tion problem. We present an approach via the value process and a second 
approach via a deflator, which corresponds to the dual problem in a suit- 
able setting. Appendix lAl belongs to Section [3] and contains the measurable 
selections for the construction of the Bellman equation. It is complemented 
by Appendix [B] where we construct an alternative parametrization of the 
market model by representative portfolios. 
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2 Preliminaries 

The following notation is used. If x,y 6 R, we denote x + = max{x,0} 
and x A y = min{x,y}. We set 1/0 := oo where necessary. If z € R d 
is a (i-dimensional vector, is its ith coordinate, z T its transpose, and 
\z\ = (z T z) 1 / 2 the Euclidean norm. If X is an Revalued semimartingale 
and 7r is an Revalued predictable integrand, the vector stochastic integral is 
a scalar semimartingale with initial value zero and denoted by j tt dX or by 
7T • X . The quadratic variation is the d x (i-matrix [X] := [X, X] and if Y is a 
scalar semimartingale, [X, Y] is the ci-vector with [X, Y] 1 := When 
the reference measure is understood, relations between measurable functions 
hold almost everywhere unless otherwise mentioned. Our reference for any 
unexplained notion from stochastic calculus is Jacod and Shiryaev |15| . 



2.1 The Optimization Problem 

We fix the time horizon T G (0, oo) and a stochastic basis (QjJ 7 , F, P), 
where the filtration F = (J 7 t)tG[o,T] satisfies the usual assumptions of right 
continuity and completeness as well as J-q = {0, Q} P-a.s. We consider an 
Revalued cadlag semimartingale R with Rq = representing the returns of d 
risky assets. Their discounted prices are given by the stochastic exponential 
S = £{R) = (^(-R 1 ), . . . , £(R d )); in the financial application, the components 
of S are assumed to be positive. Our agent also has a bank account at his 
disposal; it does not pay interest. 

The agent is endowed with a deterministic initial capital x$ > 0. A 
trading strategy is a predictable i?-integrable Revalued process 7r, where 
tt 1 indicates the fraction of wealth (or the portfolio proportion) invested 
in the ith risky asset. A consumption strategy is a nonnegative optional 
process c such that Jq Ctdt < oo P-a.s. We want to consider two cases. 
Either consumption occurs only at the terminal time T (utility from "terminal 
wealth" only); or there is intermediate consumption plus a bulk consumption 
at the time horizon. To unify the notation, we introduce the measure /i on 
[0,11 by 



H(dt) :-- 



in the case without intermediate consumption, 
dt in the case with intermediate consumption. 



Let also fi° := /i+<5{*p}, where is the unit Dirac measure at T. The wealth 
process X(ir,c) corresponding to a pair (vr, c) is defined by the equation 

X t (ir,c) = xo+ / X s _(7r,c)7r s dR s — / c s ^(ds), 0<t<T. 
Jo Jo 

We define the set of trading and consumption pairs 

A°(x ) := {(vr,c) : X(ir,c) > 0, A"„(vr,c) > and c T = X T (ir,c)}. 
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These are the strategies that satisfy the budget constraint. The convention 
ct = Xt(tt,c) means that all the remaining wealth is consumed at time 
T. We consider also exogenous constraints imposed on the agent. For each 
(u),t) G x [0, T] we are given a set ^t(w) C M d which contains the origin. 
The set of (constrained) admissible strategies is 

A(x ) : = {(vr,c) G A°(x ) : TT t (u)) G %{oS) for all (oJ,t)}; 

it is nonempty as G ^t(w). Further assumptions on the set-valued mapping 
^ will be introduced in Section 12.41 We fix the initial capital x§ and usually 
write A for A(xq). Abusing the notation, we write c G A and call c admissible 
if there exists tt such that (tt, c) G A; an analogous convention is used for 
similar expressions. 

We will often parametrize the consumption strategies as a fraction of 
wealth. Let (vr, c) G A and X = X(ir,c). Then 

c 

K:= x 

is called the propensity to consume corresponding to (tt, c). This yields a one- 
to-one correspondence between the pairs (tt, c) G A and the pairs (tt, k) such 
that tt € A and k is a nonnegative optional process satisfying J k s ds < oo 
P-a.s. and kt = 1 (see Nutz [26, Remark 2.1] for details). We shall abuse 
the notation and identify a consumption strategy with the corresponding 
propensity to consume; e.g., we write (tt, k) G A. Note that 

X(tt, k) = xo£(tt • R — k • fn. 

This simplifies verifying that some pair (tt, k) is admissible as X(tt,k) > 
implies X_(tt,k) > (cf. [15, II.8a]). 

The preferences of the agent are modeled by a time-additive random 
utility function as follows. Let D be a cadlag, adapted, strictly positive 
process such that E[ Jq D s /u°(<is)] < oo and fix p G (— oo, 0) U (0,1). We 
define the power utility random field 

U t (x) := D t \x v , xe (0,00), iG [0,T]. 

This is the general form of a p-homogeneous utility random field such that 
a constant consumption yields finite expected utility. Interpretations and 
applications for the process D are discussed in |26j . We denote by U* the 
convex conjugate of x i— >■ Ut(x), 

U t *(y) = sup {U t (x) - xy) = -\tfD$\ (2.1) 

here q := S (— oo, 0) U (0, 1) is the exponent conjugate to p and the 
constant j3 := > is the relative risk tolerance of U. Note that we 
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exclude the well-studied logarithmic utility (e.g., Goll and Kallsen which 
corresponds to p = 0. 

The expected utility corresponding to a consumption strategy c G A is 
E[ J T U t (c t ) n°(dt)] ; i.e., either E[U T {c T )} or E\J^ U t (c t ) dt + l/ T (or)]. The 
(value of the) utility maximization problem is said to be finite if 

u(a? ) := sup E f U t {c t ) fi° (dt) < oo. (2.2) 
ceA(xo) ^ Jo - 

Note that this condition is void if p < as then U < 0. If (|2.2p holds, a 
strategy (vr, c) € ^4(xo) is called optimal if £"[ J Ut(ct) fj, (dt)] = u(xq). 

Finally, we introduce the following sets; they are of minor importance 
and used only in the case p < 0: 

A f := {(tt,c) €A: j^U t (c t ) fi°(dt) > -oo}, 

A fE := {{ir,c)€A: E[fiu t (ct) n°(dt)) > -oo}. 

Anticipating that (|2.2p will be in force, the indices stand for "finite" and 
"finite expectation". Clearly A^ E C A* C A, and equality holds if p £ (0, 1). 

2.2 Opportunity Process 

We recall the opportunity process, a reduced form of the value process in the 
language of control theory. We assume (|2.2p in this section, which ensures 
that the following process is finite. By [26, Proposition 3.1, Remark 3.7] 
there exists a unique cadlag semimartingale L, called opportunity process, 
such that 

L t l(X t (TT,c)) p = esssup E\ [ U s (c s ) /x° (ds) T t ] (2.3) 

c£A(n,c,t) l Jt J 

for any (vr, c) G A, where A{tt, c, t) := {(tt,c) G A : (vf,c) = (vr, c) on [0,i]}. 
We note that Lt = Dt and that u{xq) = Lq-Xq is the value function 
from (12. 2p . The following is contained in [26, Lemma 3.5]. 

Lemma 2.1. L is a special semimartingale for all p. If p G (0,1), then 
L, L_ > up to evanescence. If p < 0, the same holds provided that an 
optimal strategy exists. 

Proposition 2.2 ([2BJ Proposition 3.4]). Let (vr,c) G A fE . Then the process 
L t l(X t (7r,c)) p + J*U s (c s )v(ds), te[0,T] 

is a supermartingale; it is a martingale if and only if (vr, c) is optimal. 

This is the "martingale optimality principle". The expected terminal 
value of this process equals E[J^ Ut{ct) fj,°(dt)], hence the assertion fails for 
(vr,c) G A\A* E . 
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2.3 Semimartingale Characteristics 

In the remainder of this section we introduce tools which are necessary to 
describe the optimization problem locally. The use of semimartingale char- 
acteristics and set-valued processes follows and |19j . which consider log- 
arithmic utility and convex constraints. That problem differs from ours in 
that it is "myopic"; i.e., the characteristics of R are sufficient to describe the 
local problem and so there is no need for an opportunity process. 

We refer to [15] for background regarding semimartingale characteristics 
and random measures. Let /j, R be the integer- valued random measure associ- 
ated with the jumps of R and let h : R d — > R d be a cut-off function; i.e., h is 
bounded and h(x) = x in a neig hborhood of x = 0. Let (B R , C R , v R ) be the 
predictable characteristics of R relative to h. The canonical representation 
ofR (cf. [15, II.2.35]) is 

R = B R + R C + h(x) * (n R - u R ) + (x- h{x)) * (j, R . (2.4) 

The finite variation process (x — h(x)) * [i R contains essentially the "large" 
jumps of R. The rest is the canonical decomposition of the semimartingale 
R = R — (x — h(x)) * [i R , which has bounded jumps: B R = B R (h) is 
predictable of finite variation, R c is a continuous local martingale, and h(x) * 
{ji R — u R ) is a purely discontinuous local martingale. 

As L is a special semimartingale (Lemma 12. ip . it has a canonical de- 
composition L = Lq + A L + M L . Here Lq is constant, A L is predictable 
of finite variation and also called the drift of L, M L is a local martingale, 
and = Mq = 0. Analogous notation will be used for other special semi- 
martingales. It is then possible to consider the characteristics (A L , C L , u L ) 
of L with respect to the identity instead of a cut-off function. Writing x' for 
the identity on R, the canonical representation is 

L = L + A L + L c + x' * (// - u L ); 

see |15| II. 2. 38]. It will be convenient to use the joint characteristics of the 
M. d x R- valued process (R, L). We denote a generic point in R d x R by (x, x') 
and let (B R,L , C R,L , v R,L ) be the characteristics of (R, L) with respect to the 
function (x,x') i— > (h(x),x'). More precisely, we choose "good" versions of 
the characteristics so that they satisfy the properties given in |I15| II. 2. 9]. For 
the (d + l)-dimensional process (R, L) we have the canonical representation 

We denote by (b R,L , c R,L , F R,L ; A) the differential characteristics with 
respect to a predictable locally integrable increasing process A] e.g., 

A t := t + Y,V^{B RL >% + Y,^(C RL ' ij )t + (\(x,x')\ 2 A 1) * v*> L . 

i i,j 



Then b R > L • A = B RL • A = C R > L , and F R - L • A = v R > L , We write 
b R > L = (b R ,a L ) T and c^^ = (( C M)T c ^zf J , i-e., c RL is a d-vector satisfying 
(c RL ) • A = (R C ,L C ). We will often use that 

f (\x\ 2 + |x'| 2 ) A (1 + F R ' L (d(x, x')) < oc (2.5) 

jR d xR 

because L is a special semimartingale (cf. [15, II. 2. 29]). Let Y be any scalar 
semimartingale with differential characteristics (b ,c Y , F ) relative to A 
and a cut-off function h. We call 

a*W + /(*-M*))F>» 

the drift rate of y whenever the integral is well defined with values in 
[—00,00], even if it is not finite. Note that a Y does not depend on the 
choice of h. If Y is special, the drift rate is finite and even j4-integrable (and 
vice versa). As an example, a L is the drift rate of L and a L • A = A L yields 
the drift. 

Remark 2.3. Assume Y is a nonpositive scalar semimartingale. Then its 
drift rate a Y is well defined with values in [—00,00). Indeed, the fact that 
Y = Y_ + AY < implies that x < -Y_, F Y (dx)-a.e. 

If y is a scalar semimartingale with drift rate a Y £ [— 00, 0], we call Y 
a semimartingale with nonpositive drift rate. Here a Y need not be finite, 
as in the case of a compound Poisson process with negative, non-integrable 
jumps. We refer to Kallsen |17j for the concept of a-localization. Denoting 
by L(A) the set of ^4-integrable processes and recalling that J-q is trivial, we 
conclude the following, e.g., from [19, Appendix 3]. 

Lemma 2.4. Let Y be a semimartingale with nonpositive drift rate. 

(i) Y is a a-supermartingale 44> a Y is finite ^ Y is a -locally of class (D). 
(ii) Y is a local supermartingale a Y € L(A) <?=>Y is locally of class (D). 
(in) IfY is uniformly bounded from below, it is a supermartingale. 

2.4 Constraints and Degeneracies 

We introduce some set-valued processes that will be used in the sequel, that 
is, for each (oj, t) they describe a subset of M. d . We refer to Rockafellar |28] 
and Aliprantis and Border [1, §18] for background. 

We start by expressing the budget constraint in this fashion. The process 

%°(uj) := jy G R d : F t R (io){x G R d : y T x < -l} = o} 

was called the natural constraints in |19j . Clearly 'tf is closed, convex, 
and contains the origin. Moreover, one can check (see |19[ §3.3]) that it is 
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predictable in the sense that for each closed GCR, the lower inverse image 
(^°Y l (G) = {(u),t) : %{oj) n G ^ 0} is predictable. (Here one can replace 
closed by compact or by open; see |28| 1A].) A statement such as " < ^° is 
closed" means that ^f{u) is closed for all (ui,t); moreover, we will often 
omit the arguments (ui,t). We also consider the slightly smaller set-valued 
process 

<tf°<* : = L G R d : F R {x G R d : y T x < -l} = o}. 

These processes relate to the budget constraint as follows. 

Lemma 2.5. A process tt G L(R) satisfies S(tt • R) > (> 0) up to evanes- 
cence if and only if it G <?f (<?f '*) P ® A-a.e. 

Proof. Recall that f (tt • R) > if and only if 1 + vr T AP > ([EJ II. 8a]). 
Writing V(x) = l^ x . i +7T T x < y (x), we have that (P ® A){ir f£ 't? '*} = 

E[V(x) * v%] = E[V{x) * i4] = P[E s <t 1 {x-. i+7rjAi? fl <0}] ■ For the equiva- 
lence with < ^ ?0 , interchange strict and non-strict inequality signs. □ 

The process ^°'* is not closed in general (nor relatively open). Clearly 
<jf0,* q <^ an( j j n £ act <^o j g ^ e c i osure f <^o,*. f or y e ^(oj), the sequence 

{(1 — l/n)y} n >i is in ^'*(uj) and converges to y. This implies that < ^ ?0 >* 
is predictable; cf. [1, 18.3]. We will not be able to work directly with < ^' '* 
because closedness is essential for the measurable selection arguments that 
will be used. 

We turn to the exogenous portfolio constraints; i.e., the set-valued process 
^ containing the origin. We consider the following conditions: 

(CI) c £ is predictable. 

(C2) ^ is closed. 

(C3) If p G (0, 1): There exists a (0, l)-valued process rj such that 
ye{ < tfntf°)\ tf '* => t|i/e^ for all j] G (77, 1),~P <g> A-a.e. 

Condition (C3) is clearly satisfied if ^n^ C < ^ 5 ° , * ; which includes the case 
of a continuous process P, and it is always satisfied if ^ is convex or, more 
generally, star-shaped with respect to the origin. If p < 0, (C3) should be 
read as always being satisfied. 

We require (C3) to exclude a degenerate situation where, despite the 
Inada condition U'(0) = 00, it is actually desirable for the agent to have 
a wealth process that vanishes in some states. That situation, illustrated 
in the subsequent example, would necessitate a more complicated notation 
while it can arise only in cases that are of minor interest. 

Example 2.6. We assume that there is no intermediate consumption and 
Xo = 1. Consider the one-period binomial model of a financial market; i.e., 
S = £(R) is a scalar process which is constant up to time T, where it has 
a single jump; say, P[ARt = —1] = po and P[AP^ = K] = 1 — po, where 
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K > is a constant and po € (0, 1). The nitration is generated by R and 
we consider <if = {0} U {1}. Then E[U(X T {ir))} = U(l) if vr T = and 
E[U(X t (tt))] = Po U(0) + (l-p )U{l + K) if ir T = 1. If 17(0) > -oo, and if 
K is large enough, ttt = 1 performs better despite the fact that its terminal 
wealth vanishes with probability po > 0. Of course, this cannot happen if 
U(0) = -oo, i.e., p < 0. 

By adjusting the constants in the example, one can also see that under 
non-convex constraints, there is in general no uniqueness for the optimal 
wealth processes (even if they are positive). 

The final set- valued process is related to linear dependencies of the assets. 
As in [19J, the predictable process of null-investments is 

,jV := {y £ R d : y T b R = 0, y T c R = 0, F R {x : y T x + 0} = 0}. 

Its values are linear subspaces of M. d , hence closed, and provide the pointwise 
description of the null-space of H \— > H • R. That is, H € L(R) satisfies 
H • R = if and only if H E jY P (g> A-a.e. An investment with values in 
jY has no effect on the wealth process. 

3 The Bellman Equation 

We have now introduced the necessary notation to formulate our first main 
result. Two special cases of our Bellman equation can be found in the pio- 
neering work of Mania and Tevzadze [23j and Hu et al. |14j . These articles 
consider models with continuous asset prices and we shall indicate the con- 
nections as we specialize to that case in Section 13.31 A related equation also 
arises in the study of mean-variance hedging by Cerny and Kallsen [5] in 
the context of locally square-integrable semimartingales, although they do 
not use dynamic programming explicitly. Due to the quadratic setting, that 
equation is more explicit than ours and the mathematical treatment is quite 
different. Czichowsky and Schweizer [7] study a cone-constrained version of 
the related Markowitz problem and there the equation is no longer explicit. 

The Bellman equation highlights the local structure of our utility max- 
imization problem. In addition, it has two main benefits. First, it can be 
used as an abstract tool to derive properties of the optimal strategies and the 
opportunity process (e.g., Nutz |27j). Second, one can try to solve the equa- 
tion directly in a given model and to deduce the optimal strategies. This is 
the point of view taken in Section [5] and obviously requires the precise form 
of the equation. 

The following assumptions are in force for the entire Section [3] 

Assumptions 3.1. The value of the utility maximization problem is finite, 
there exists an optimal strategy (tt,c) € A, and ^ satisfies (C1)-(C3). 
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3.1 Bellman Equation in Joint Characteristics 

Our first main result is the Bellman equation stated as a description of 
the drift rate of the opportunity process. We recall the conjugate function 

Theorem 3.2. The drift rate a L of the opportunity process satisfies 

max 



p- 1 a L = U*(L-)%£ + max.sCy), (3-1) 



where g is the predictable random function 

g(y) := L_y T (b R + ^ + ^c R y) + [ x'y T h(x) F R > L (d(x,x>)) 

+ f (L^+x'){p- 1 (l + y T x) p -p- 1 -y T h(x)}F R ' L (d{x,x')). 

JM d xR 

(3.2) 

The unique (P (g> fj,°-a.e.) optimal propensity to consume is 



L. 



(3.3) 



Any optimal trading strategy tt* satisfies 



tt* 6 argmaxg (3.4) 

and the corresponding optimal wealth process and consumption are given by 

X* = x £ (tt* • R- k • /i); c* = X*k. 

We shall see in the proof that the maximization in (|3.ip can be under- 
stood as a local version of the optimization problem. Indeed, recalling (12. ip . 
the right hand side of (|3.ip is the maximum of a single function over certain 
points (k, y) eR+ x R d that correspond to the admissible controls (k,tt). 
Moreover, optimal controls are related to maximizers of this function, a char- 
acteristic feature of any dynamic programming equation. The maximum of 
g is not explicit due to the jumps of R; this simplifies in the continuous case 
considered in Section 13.31 below. Some mathematical comments are also in 
order. 

Remark 3.3. (i) The random function g is well defined on in the 
extended sense (see Lemma IA.2|) and it does not depend on the choice 
of the cut-off function h bv [151 II.2.25]. 

(ii) For p < we have a more precise statement: Given ir* 6 L(R) and k 
as in (|3.3p . (it*, k) is optimal if and only if tt* takes values in c £ n 
and maximizes g. This will follow from Corollary 15.41 applied to the 
triplet (L, tt* , k). 
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(iii) For p 6 (0,1), partial results in this direction follow from Section [5] 
The question is trivial for convex ^ by the next item. 

(iv) If ^€ is convex, arg max^ n ^o g is unique in the sense that the difference 
of any two elements lies in JV (see Lemma |A.3|) . 

We split the proof of Theorem 13 . 2 1 into several steps; the plan is as follows. 
Let (it, k) G A^ E and denote X = X(tt,k). We recall from Proposition 12.21 
that 

Z(tt,k) := L\X p + f U s (k s X s ) fi(ds) 

is a supermartingale, and a martingale if and only if (tt, n) is optimal. Hence 
we shall calculate its drift rate and then maximize over (tt, k); the maximum 
will be attained at any optimal strategy. This is fairly straightforward and 
essentially the content of Lemma 13.71 below. In the Bellman equation, we 
maximize over a subset of M. d for each (co,t) and not over a set of strategies. 
This final step is a measurable selection problem and its solution will be the 
second part of the proof. 

Lemma 3.4. Let (tt,k) G A^ . The drift rate of Z(tt,k) is 

a Zfr,K) = X(7F; K) P_ ( p - V + + gfr)) E [-OO, OO), 

where ft(k) := Ut(k) — Lt-k and g is given by (|3.2p . Moreover, a z ( n ' K ^ = 0, 
and a z(n ^ G (-oo,0] for (tt, k) G A fE . 

Proof. We can assume that the initial capital is xq = 1. Let (tt, k) G A? , 
then in particular Z := Z(tt, k) is finite. We also set X := X(tt, k). By Ito's 
formula, we have X p = £(tt * R — k * = £ (Y) with 

Y = p(?r • R - k • n) + &^-ir T c R -n • A + { (1 + n T x) p - 1 - pir T x} * fj, R . 

Integrating by parts in the definition of Z and using X s = X s - fi(ds)-&.e. 
(path-by-path), we have XZ P • Z = p- 1 (L-L + L^ • Y + [L,Y]) + U(k) • fx. 
Here 

[L,Y} = [L c , Y c ] + ALAF 

= pir T c RL • A+ P x'tt t x * fi R ' L + x'{(l + tt t x) p - 1 - pir T x} * /j, R ' L . 
Thus X_ p • Z equals 

p-\L - Lq) + L-TT • R + /(«) • H + L_^=^7T T C H 7T • A + TT T C RL ' A 

+ X'TT T X * + (L_ + x'){p~ 1 {l + TT T X ) P - p' 1 - 7T T X } * ^ L . 

Writing x = h(x) + x — h(x) and R = R — (x — h(x)) * jji R as in (|2.4|) . 
XI P • Z = (3.5) 

P -\L - Lq) + L_7T • R + /(«) • /i + i-7T T (^ + ^C R 7t) • A 
+ xV T /l(x) * fl R ' L + (L_ + + 7T T X) P - p" 1 - TT T h(x)} * /i R ' L . 
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Since tt need not be locally bounded, we use from now on a predictable cut- 
off function h such that ir T h(x) is bounded; e.g., h(x) = xl{| x |<i}n{|7r T a;|<i}- 
Then the compensator of x'ir T h(x) * fi R,L exists, since L is special. 

Let (tt, k) G A^ E . Then the compensator of the last integral in the 
right hand side of fj3 . 5 [) also exists; indeed, all other terms in that equality 
are special, since Z is a supermartingale. The drift rate can now be read 
from (|3.5p and (|2.4p . and it is nonpositive by the supermartingale property. 
The drift rate vanishes for the optimal (tt, k) by the martingale condition 
from Proposition 12.21 

Now consider (tt,k) G A.* \ A* E ■ Note that necessarily p < (otherwise 
Jj = A fE ). Thus Z < 0, so by Remark the drift rate a z is well 
defined with values in [—00,00) — alternatively, this can also be read from 
the integrals in (|3.5p via (|2.5p . Using directly the definition of a z , we find 
the same formula for a z is as above. □ 

We do not have the supermartingale property for (tt, k) G A* \A? E , so it 
is not evident that a z ^ ,K ^ < in that case. However, we have the following 

Lemma 3.5. Let (tt, k) G A? . Then a z (tt, k) G [0, 00] implies a z (tt, k) = 0. 

Proof. Denote Z = Z(tt,k). For p > we have A* = A^ E and the 
claim is immediate from Lemma 13.41 Let p < 0. Then Z < and by 
Lemma I2,4f iii). a z E [0, 00] implies that Z is a submartingale . Hence 
E[Z T ] = E[J^Ut(K t X t (TT,K))fi°(dt)] > -00, that is, (tt,k) G A fE . Now 
Lemma 13.41 yields a z (TT,K) < 0. □ 

We observe in Lemma [3.4l that the drift rate splits into separate functions 
involving k and tt, respectively. For this reason, we can single out the 

Proof of the consumption formula (|3.3p . Let (tt, k) G A. Note the follow- 
ing feature of our parametrization: we have (tt, m*) G A for any nonnega- 
tive optional process k* such that J* Q k* fJ>(ds) < 00 and = 1. Indeed, 
X(tt, k) = xo£(tt • R — K m (j,) is positive by assumption. As fi is continuous, 
X(tt, k*) = xq£(tt • R — k* • jj) is also positive. 

In particular, let (tt, k) be optimal, /3 = (1—p)" 1 and k* = (D/L)"; then 
(tt, «*) G A. In fact the paths of U(k*X(tt, «*)) = p- 1 D^ 1 X(7T J k*) p L-^p 
are bounded P-a.s. (because the processes are cadlag; L, L_ > and /3p+l = 
(3 > 0) so that (tt,k*) G .AA 

Note that P ® fi-a.e., we have k* = (D/L^) 13 = argmax fe>0 /(fc), hence 
/(«*) > /(&)■ Suppose (P (g) n){f(K*) > f(k)} > 0, then the formula from 
LemmaET4land a z( *'^ = imply a Z ^' K *^> > and (P®A){a z ^' K,) > 0} > 0, 
a contradiction to Lemma 13.51 It follows that k = k* P (8> /i-a.e. since / has 
a unique maximum. □ 

Remark 3.6. The previous proof does not use the assumptions (C1)-(C3). 
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Lemma 3.7. Let it be a predictable process with values in ff R ff '* . Then 

(P®A){g(7r) <g(7T)} =0. 

Proof. We argue by contradiction and assume (P <g> A){g(jt) < g(ir)} > 0. 
By redefining tt, we may assume that tt = tt on the complement of this 
predictable set. Then 

9 {tt) < g(ir) and (P ® A){ 5 (vr) < 9 {tt)} > 0. (3.6) 

As tt is u-bounded, we can find a constant C > such that the process 
tt : = 7rlu.|<cr + ^\tt\>c again satisfies fj3.6jt ; that is, we may assume that tt 
is P-integrable. Since tt € *<f fl < ^ 7 °'*, this implies (7r, k) € .4 (as observed 
above, the consumption k plays no role here). The contradiction follows as 
in the previous proof. □ 

In view of Lemma 13. 7| the main task will be to construct a measurable 
maximizing sequence for g. 

Lemma 3.8. Under Assumptions \3.1\ there exists a sequence (7r n ) of pre- 
dictable (Iff °'* -valued processes such that 

limsup <?(7T n ) = sup g P <S> A-a.e. 

We defer the proof of this lemma to Appendix |A] together with the study 
of the properties of g. The theorem can then be proved as follows. 

Proof of Theorem \3.S[ Let n n be as in Lemma 13.81 Then Lemma 13.71 with 
tt = TT n yields g(jr) = sup^ n <^o g, which is (|3.4p . By Lemma 13.41 we have 
= a z ^^ = p- x a L + f{k)% + g{Tr). This is as f{k) = U*(LJ) 

P (8) //-a.e. due to (f3~3|) . □ 

3.2 Bellman Equation as BSDE 

In this section we express the Bellman equation as a BSDE. The unique 
orthogonal decomposition of the local martingale M L with respect to R 
(cf. |15[ III. 4. 24]) leads to the representation 

L = L + A L + ip L • R c + W L * {fi R - v R ) + N L , (3.7) 

where, using the notation of [15], (f L £ -^Lc(-^ C )' W L € Gi oc (fi R ), and N L is 
a local martingale such that {(N L ) C ,R C ) = and M P R {AN L \V) = 0. The 
last statement means that E[(VAN L )*i4] = for any sufficiently integrable 
predictable function V = V(u:,t,x). We also introduce 

W t L := [ W L (t,x) v R ({t} x dx), 
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then A(W L * (^ R - v R )) = W l (AR)1 {ARj l 0} - W L by definition of the 
purely discontinuous local martingale W L * (jj, r — v R ) and we can write 

AL = AA L + W L (AR)l {ARm -W L + AN L . 

We recall that Assumptions 13.11 are in force. Now (|3.ip can be restated as 
follows, the random function g being the same as before but in new notation. 

Corollary 3.9. The opportunity process L and the processes defined by (|3.7p 
satisfy the BSDE 

L = L -pU*{L_)- (i-p max g(y) • A + ip L • R c + W L * {^ R - v R ) + N L 

(3-8) 

with terminal condition Lt = Dt, where g is given by 

g(y) ■= 

L_y T (b R + c R (^ + ^y)) + / {AA L + W L (x)-W L )y T h(x)F R {dx) 
+ / (L- + AA L + W L (x)-W L ){p- 1 (l + y T x) p -p- 1 -y T h(x)}F R (dx). 

We observe that the orthogonal part N L does not appear in the definition 
of g. In a suitable setting, it is linked to the "dual problem"; see Remark l5.18l 

It is possible (but notationally more cumbersome) to prove a version of 
Lemma 13.41 using g as in Corollary 13.91 and the decomposition (|3.7p , thus 
involving only the characteristics of R instead of the joint characteristics 
of (R,L). Using this approach, we see that the increasing process A in the 
BSDE can be chosen based on R and without reference to L. This is desirable 
if we want to consider other solutions of the equation, as in Section [4] One 
consequence is that A can be chosen to be continuous if and only if R is 
quasi left continuous (cf. [15, II. 2. 9]). Since p~ l A L = —f(k) m fi — g{^) ' A, 
V&r(A L ) is absolutely continuous with respect to A + /x, and we conclude: 

Remark 3.10. If R is quasi left continuous, A L is continuous. 

If R is quasi left continuous, u R ({t} x R d ) = for all t by [TSJ II.1.19], 
hence W L = and we have the simpler formula 

g (y) = L_y T (b R + c R (^ + ^y))+ [ W L (x)y T h(x)F R (dx) 

+ [ (L_ +W L (x)){p~ 1 (l + y T x) p -p- 1 -y T h(x)} F R (dx). 
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3.3 The Case of Continuous Prices 

In this section we specialize the previous results to the case where R is a 
continuous semimartingale and mild additional conditions are satisfied. As 
usual in this setting, the martingale part of R will be denoted by M rather 
than R c . In addition to Assumptions 13.11 the following conditions are in 
force for the present Section 13.31 

Assumptions 3.11. 

(i) R is continuous, 

(ii) R = M + J d(M)\ for some A € L? (M) (structure condition), 

(iii) the orthogonal projection of onto jV^ is closed. 

Note that <^ '* = R d due to (i), in particular (C3) is void. When R is 
continuous, it necessarily satisfies (ii) when a no- arbitrage property holds; 
see Schweizer [29J. By (i) and (ii) we can write the differential characteristics 
of R with respect to, e.g., At := t + Yli=i(^ l )t- It will be convenient to 
factorize c R = aa T , where a is a predictable matrix- valued process; hence 
aa T dA = d(M). Then (ii) implies j¥ = ker a T because (ja T y = implies 
(a T y) T (a T y) = 0. Since cr T : ker(<r T )^ — > a T R d is a homeomorphism, we 
see that (iii) is equivalent to 

a Tc & is closed. 

This condition depends on the semimartingale R. It is equivalent to the 
closedness of ^ itself if a has full rank. For certain constraint sets (e.g., 
closed polyhedral or compact) the condition is satisfied for all matrices a, but 
not so, e.g., for non-polyhedral cone constraints. We mention that violation 
of (iii) leads to nonexistence of optimal strategies in simple examples (cf. |25| 
Example 3.5]) and we refer to Czichowsky and Schweizer [8] for background. 
Under (i), (|3.7p is the more usual Kunita-Watanabe decomposition 

L = L + A L + ip L • M + N L , 

where ip L € Lf (M) and N L is a local martingale such that [M , N L ] = 0; 
see Ansel and Strieker p, cos 3]. If ^ K C R d is a closed set, we denote 
the Euclidean distance to K by dx(x) = min{|x — y\ : y € K}, and d\ is 
the squared distance. We also define the (set-valued) projection IT^ which 
maps i G R rf to the points in K with minimal distance to x, 

U K (x) = {y£K: \x-y\= d K {x)} + 0. 

If K is convex, H K is the usual (single-valued) Euclidean projection. In the 
present continuous setting, the random function g simplifies considerably: 

g(y) = L_y T aa T (a + ^- + ^y) (3.9) 
and so the Bellman BSDE becomes more explicit. 
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Corollary 3.12. Any optimal trading strategy n* satisfies 



■d-p)-(» + B}- 

T/ie opportunity process satisfies the BSDE 

L = L - pU*(L^) • fi + F(L_, y> L ) • A + y? L • M + N L ; L T = D T , 

where 
F(L_,cp L ) = 



(^ L \ 2 



If ^ is a convex cone, F{L„,ip L ) = ^JL^LJ[W' ^ {a T (A + ^)}| 2 . If 
<T = R d , then F(L-,<p L ) • A = f L_(A + ^-) T d(M) (A + £-) and 

the unique (mod. JV ) optimal trading strategy is it* = (1 — p) _1 (A + ^— ). 

Proo/. Let/3 = (1-p) -1 - We obtain o- T (arg max^ 5 ) = n aT%f {o- T /3(A+f^) } 
by completing the square in (|3.9p . moreover, for any ir* £ argmax^ g, 

g(n*) = iL_ {/? (A + T ,a T (a + - fT ^ (V/3 ( A + j£) ) } . 

In the case where and hence o~ Tc to ', is a convex cone, IT := iI°" T ^ is single- 
valued, positively homogeneous, and IIx is orthogonal to x — Tlx for any 
x G M d . Writing := cj t (A+ j£) we get 5 (vr*) = L_/3(n^) T (* - §11*) = 

L_i/3(n*) T (n*). Finally, = f if ^ = R d . The result follows from 
Corollary 031 □ 

Of course the consumption formula H 3 . 3 [) and Remark 13.31 still apply. We 
remark that the BSDE for the unconstrained case <tf = R d (and p = 0, 
D = 1) was previously obtained in |23| in a similar spirit. A variant of the 
constrained BSDE for an Ito process model (and p = 0, D = 1) appears 
in |14] . where a converse approach is taken: the equation is derived only 
formally and then existence results for BSDEs are employed together with a 
verification argument. We shall extend that result in Section l5l ( Example 15 . 8|) 
when we study verification. 

If L is continuous, the BSDE of Corollary 13.121 simplifies if it is stated 
for log(L) rather than L, but in general the given form is more convenient 
as the jumps are "hidden" in N L . 
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Remark 3.13. (i) Continuity of R does not imply that L is continuous. For 
instance, in the ltd process model of Barndorff-Nielsen and Shephard |3] with 
Levy driven coefficients, the opportunity process is not continuous. See, e.g., 
Theorem 3.3 and the subsequent remark in Kallsen and Muhle-Karbe |18j . If 
R satisfies the structure condition and the filtration F is continuous, it clearly 
follows that L is continuous. Here F is called continuous if all F-martingales 
are continuous, as, e.g., for the Brownian filtration. In general, L is related 
to the predictable characteristics of the asset returns rather than their levels. 
As an example, Levy models have jumps but constant characteristics; here 
L turns out to be a smooth function (see [25j). 

(ii) In the present setting we see that F has quadratic growth in (p L , 
so that the Bellman equation is a "quadratic BSDE" (see also Example 15. 8p . 
In general, F does not satisfy the bounds which are usually assumed in 
the theory of such BSDEs. Together with existence results for the utility 
maximization problem (see the citations from the introduction), the Bellman 
equation yields various examples of BSDEs with the opportunity process as 
a solution. This includes terminal conditions Dt which are integrable and 
unbounded (see also |26| Remark 2.4]). 

4 Minimality of the Opportunity Process 

This section considers the Bellman equation as such, having possibly many 
solutions, and we characterize the opportunity process as the minimal solu- 
tion. As mentioned above, it seems more natural to use the BSDE formula- 
tion for this purpose (but see Remark I4.4[) . We first have to clarify what we 
mean by a solution of the BSDE. We consider R and A as given. Since the 
finite variation part in the BSDE is predictable, a solution will certainly be 
a special semimartingale. If I is any special semimartingale, there exists a 
unique orthogonal decomposition |15| III. 4. 24] 

I = £ + A 1 + ip e • R c + W e * (fi R - u R ) + N £ , (4.1) 

using the same notation as in ()3.7jl . These processes are essentially unique, 
and so it suffices to consider the left hand side of the BSDE for the notion 
of a solution. (In BSDE theory, a solution would be, at least, a quadruple.) 
We define the random function g l as in Corollary 13. 9| with L replaced by I. 
Since t is special, we have 

f (\x\ 2 + \x'\ 2 ) A (1 + \x'\) F R ' e (d(x, x')) < oo (4.2) 

and the arguments from Lemma IA.2I show that </ is well defined on with 
values in M U {sign(p)oo}. Hence we can consider (formally at first) the 
BSDE (|3S|) with L replaced by £; i.e., 

£ = e - P U*(£.) • fi-p max g e (y) • A+ip e • R c +W e *(n R -u R )+N £ (4.3) 

y£ c tfn c t?° 
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with terminal condition £t = Dt- 

Definition 4.1. A cadlag special semimartingale £ is called a solution of the 
Bellman equation (|4.3p if 

• £,£^ > 0, 

• there exists a n ^°'*-valued process tt G £(-R) such that g> (?f) = 
su P<rn^o g* <oo, 

• £ and the processes from (|4,ip satisfy (|4,3p with £t = Dt- 

Moreover, we define k := (D/£)P, where /? = (1 — We call (tt,k) the 

strategy associated with £, and for brevity, we also call (£, fr, k) a solution. 

If the process if is not unique, we choose and fix one. The assumption 
£ > excludes pathological cases where £ jumps to zero and becomes posi- 
tive immediately afterwards and thereby ensures that k is admissible. More 
precisely, the following holds. 

Remark 4.2. Let (£,if,k) be a solution of the Bellman equation. 

(i) (vr, k) G A* E . 

(ii) sup<^ n <^o g is a predictable, A-integrable process. 

(iii) If p G (0, 1), g l is finite on c € n 

(iv) The condition £ > is automatically satisfied if (a) p G (0, 1) or if (b) 
p < and there is no intermediate consumption and Assumptions 13.11 
are satisfied. 

Proof, (i) We have k s fj,(ds) < oo P-a.s. since the paths of £ are bounded 
away from zero. Moreover, jT Ut(ktXt(jt, k)) /J,(dt) < oo as in the proof 
of (|3.3p (stated after Lemma 13 . 5 [> . This shows (tt, k) G A.. The fact that 
(tt, k) G Jv is contained in the proof of Lemma 14.91 below. 

(ii) We have = g (0) < sup^ n >^o g l = g ' (fr). Hence sup^ n ^o g £ • A is 
well defined, and it is finite because otherwise (|4.3p could not hold. 

(iii) Note that p > implies g e > —oo by its definition and (|4.2p . while 
g < oo by assumption. 

(iv) If p > 0, (|4.3p states that A is decreasing. As £^ > implies £ > 0, 
£ is a supermartingale by Lemma 12.41 Since £t = Dt > 0, the minimum 
principle for nonnegative supermartingales shows £ > 0. Under (b) the 
assertion is a consequence of Theorem 14.51 below (which shows £ > L > 0) 
upon noting that the condition £ > is not used in its proof when there is 
no intermediate consumption. □ 

It may seem debatable to make existence of the maximizer if part of the 
definition of a solution. However, associating a control with the solution is 
crucial for the following theory. Some justification is given by the following 
result for the continuous case (where ^ '* = M. d ). 
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Proposition 4.3. Let t be any cadlag special semimartingale such that 
£,£- > 0. Under Assumptions UH\ (CI) and (C2), there exists a n^ '*- 
valued predictable process tt such that g e (Tt) = sup^ n <^o g e < oo, and any 
such process is R-integrable. 

Proof. As g e is analogous to (|3.9p . it is continuous and its supremum over 
M. d is finite. By continuity of R and the structure condition, tt G L{R) if and 
only if J Q T vr T d(M)iT = J Q T |o- T vr| 2 dA < oo P-a.s. 

Assume first that ^ is compact, then Lemma IA.4I yields a measurable 
selector tt for arg max^ g. As in the proof of Corollary l3~T2l a 1 tt G IF V (T T ijj 
for if) := /3(A + , which satisfies \a T tp\ 2 dA < oo by definition of A and 
(fr. We note that \o- t tt\ < \a T ifj\ + \a T TT—a T ^\ < 2 [cr T ^| due to the definition 
of the projection and G *«f . 

In the general case we approximate ^ by a sequence of compact con- 
straints c € n := ^ n {x G M. d : \x\ < n}, each of which yields a selector TT n 
for argmaxyng. By the above, |cr T 7r n [ < 2\a T i/j\, so the sequence (a T TT n ) n 
is bounded for fixed (oj,t). A random index argument as in the proof of 
Lemma lA.41 yields a selector $ for a cluster point of this sequence. We have 
$ G o- Tt ta by closedness of this set and we find a selector it for the preimage 
((o" T ) _1 ^)n^ using |28| 1Q]. We have tt G argmax^> g as the sets c £ n increase 
to "jf , and J Q T |cr T 7r| 2 gL4 < 2 J Q T Ict 1 "^) 2 dA < oo shows fr G L(R). □ 

Another example for the construction of tt is given in |25[ §5]. In general, 
two ingredients are needed: Existence of a maximizer for fixed (u, t) will 
typically require a compactness condition in the form of a no-arbitrage as- 
sumption (in the previous proof, this is the structure condition). Moreover, 
a measurable selection is required; here the techniques from the appendices 
may be useful. 

Remark 4.4. The BSDE formulation of the Bellman equation has the ad- 
vantage that we can choose A based on R and speak about the class of 
all solutions. However, we do not want to write proofs in this cumber- 
some notation. Once we fix a solution t (and maybe L, and finitely many 
other semimartingales), we can choose a new reference process A = A + A' 
(where A' is increasing), with respect to which our semimartingales admit 
differential characteristics; in particular we can use the joint characteristics 
(b R,i ,c R ' £ ,F R, *-;A). As we change A, all drift rates change in that they 
are multiplied by dA/dA, so any (in)equalities between them are preserved. 
With this in mind, we shall use the joint characteristics of (R, £) in the se- 
quel without further comment and treat the two formulations of the Bellman 
equation as equivalent. 

Our definition of a solution of the Bellman equation is loose in terms of 
integrability assumptions. Even in the continuous case, it is unclear "how 
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many" solutions exist. The next result shows that we can always identify L 
by taking the smallest one; i.e., L < £ for any solution I, 

Theorem 4.5. Under Assumptions \3. i\ the opportunity process L is char- 
acterized as the minimal solution of the Bellman equation. 

Remark 4.6. As a consequence, the Bellman equation has a bounded solu- 
tion if and only if the opportunity process is bounded (and similarly for other 
integrability properties). In conjunction with [26, §4.2] this yields examples 
of quadratic BSDEs which have bounded terminal value (for Dt bounded), 
but no bounded solution. 

The proof of Theorem 14.51 is based on the following result; it is the fun- 
damental property of any Bellman equation. 

Proposition 4.7. Let (£,TT,k) be a solution of the Bellman equation. For 
any (tt, k) £ A* , 

Z(tt, k) := i\ (X(tt, k)) p + J U s (k s X s (tt, «)) n(ds) (4.4) 

is a semimartingale with nonpositive drift rate. Moreover, Z(fr, k) is a local 
martingale. 

Proof. Let (tt,k) G A f . Note that Z := Z( tt, k) satisfies sign(p)Z > 0, 
hence has a well defined drift rate a z by Remark 12.31 The drift rate can be 
calculated as in Lemma 13.41 If _p is defined similarly to the function / in 
that lemma but with L replaced by £, then 

a z = X(n, nf_ {p~ l a e + f(n) g + </(tt)} 

= X(ir,Kt{(f\K) - f{k)) ^ + ^(7r) -g e (n)}. 

This is nonpositive because k and tt maximize / and gr. For the special 
case (tt, k) := (it, k) we have a z = and so Z is a <7-martingale, thus a local 
martingale as sign(p)Z > 0. □ 

Remark 4.8. In Proposition 14.71 "semimartingale with nonpositive drift 
rate" can be replaced by "cr-supermartingale" if g^ is finite on ^ n 

Theorem 14.51 follows from the next lemma (which is actually stronger). 
We recall that for p < the opportunity process L can be defined without 
further assumptions. 

Lemma 4.9. Let £ be a solution of the Bellman equation. If p < 0, then 
L < £. For p S (0, 1), the same holds if (|2.2p is satisfied and there exists an 
optimal strategy. 



20 



Proof. Let (£, tt, k) be a solution and define Z(tt, k) as in fj4.4[> . 

Case p < 0: We choose (tt, ft) := (Tf,k). As Z(jt,K) is a negative lo- 
cal martingale by Proposition 14,71 it is a submartingale. In particular, 
E[Zt(tt, &)] > — oo, and using = Dy, this is the statement that the 
expected utility is finite, i.e., (fr, k) € -4/^ — this completes the proof of Re- 
mark 0~2fi). Recall that fj, = fj, + <5{t}- With X := X(tt, k) and c := kX, 
and using 1? = Dt = Lt, we deduce 



t ±Xf + J*U s (c s )ti(ds) = Z t (Tr,k) <E[Z T {n,k)\T t 

U s (c s ) n°(ds) 
U s (c s ) /j,(ds), 



< essswp SeA ^ At) E 



+ 



U s (c s ) fi(ds) 



where the last equality holds by (|2.3p . As -Xf < 0, we have it > Lf. 

Case p G (0,1): We choose (vr, k) := (tt, k) to be an optimal strategy. 
Then Z(tt, k) > is a supermartingale by Proposition 14 . 7l and Lemma|2]4jiii), 
and we obtain 



i t \X\ + J*U s {c s )n(ds) = Z t (ir,k) > E[Z T (7r,k)\T t _ 



E 



U s (c s ) /i° (ds) 



U s (c s ) n(ds) 



by the optimality of (tt, k) and (|2.3p . More precisely, we have used the fact 
that (tt, k) is also conditionally optimal (see |26| Remark 3.3]). As ^Xf > 0, 
we conclude it > Lf. □ 



5 Verification 

Suppose that we have found a solution of the Bellman equation; then we want 
to know whether it is the opportunity process and whether the associated 
strategy is optimal. In applications, it might not be clear a priori that 
an optimal strategy exists or even that the utility maximization problem 
is finite. Therefore, we stress that in this section these properties are not 
assumed. Also, we do not need the assumptions on ^ made in Section \2. 41 — 
they are not necessary because we start with a given solution. 

Generally speaking, verification involves the candidate for an optimal 
control, (if, k) in our case, and all the competing ones. It is often very 
difficult to check a condition involving all these controls, so it is desirable to 
have a verification theorem whose assumptions involve only (tt, k). 

We present two verification approaches. The first one is via the value pro- 
cess and is classical for general dynamic programming: it uses little structure 
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of the given problem. For p G (0, 1), it yields the desired result. However, 
in a general setting, this is not the case for p < 0. The second approach 
uses the concavity of the utility function. To fully exploit this and make the 
verification conditions necessary, we will assume that ^ is convex. In this 
case, we shall obtain the desired verification theorem for all values of p. 

5.1 Verification via the Value Process 

The basis of this approach is the following simple result; we state it separately 
for better comparison with Lemma [5.101 b elow . In the entire section, Z(tt, k) 
is defined by (|4.4p whenever £ is given. 

Lemma 5.1. Let £ be any positive cddldg semimartingale with £j< = Dt and 
let (tt, k) G A. Assume that for all (tt,k) G A* e , the process Z(tt,k) is a 
supermartingale. Then Z(tt, k) is a martingale if and only if (|2,2p holds and 
(tt, k) is optimal and £ = L. 

Proof. "=>": Recall that Zq(tt,k) = £q~x*q does not depend on (tt,k) and 

that E[Zt{k, k)] = E[Jq Ut(Kt(X t (TT, k))) fi°(dt)] is the expected utility cor- 
responding to (tt, k). With X := X(tt,k), the (super) martingale condi- 
tion implies that E[J^ U t (k t X t ) n°(dt)] > E[J^ U t (K t X t (iT, «)) n°(dt)] for 
all (tt,k) G A^ E . Since for (tt, k) G A\A$ e the expected utility is — oo, this 
shows that (tt, k) is optimal with E[Zt(tt, k)] = Zq(t^,k) = ^Op x o ^ °°- m 
particular, the opportunity process L is well defined. By Proposition 12. 2| 
L^X P + f U s (c s ) n(ds) is a martingale, and as its terminal value equals 
Zt(tt, k), we deduce £ = L by comparison with (|4.4jl . using X > 0. 

The converse is contained in Proposition 12.21 □ 

We can now state our first verification theorem. 

Theorem 5.2. Let (£,tt,k) be a solution of the Bellman equation, 
(i) If p G (0,1), the following are equivalent: 

(a) Z(jf,k) is of class (D), 

(b) Z(fr,k) is a martingale, 

(c) (|2.2p holds and (n, k) is optimal and £ = L. 
(ii) If p < 0, the following are equivalent: 

(a) Z(-k,k) is of class (D) for all (tt,k) G A^ E , 

(b) Z(tt,k) is a supermartingale for all (tt,k) G A* E , 

(c) (tt , k) is optimal and £ = L . 

Proof. When p > and (it, k) G -4/, Z(tt,k) is positive and a z ^ w ' K ^ < by 
Proposition 14. 7| hence Z(tt, k) is a supermartingale according to Lemma [2.41 
By Proposition 14. 71 Z(tt, k) is a local martingale, so it is a martingale if and 
only if it is of class (D). Lemma |5. II implies the result. 
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If p < 0, Z(tt, k) is negative. Thus the local martingale Z(tt , k) is a 
submartingale, and a martingale if and only if it is also a supermartingale. 
Note that a class (D) semimartingale with nonpositive drift rate is a super- 
martingale. Conversely, any negative supermartingale Z is of class (D) due 
to the bounds > Z > E[Zt\F]. Lemma 15. II implies the result after noting 
that if i = L, then Proposition 12.21 yields (b). □ 

Theorem 15. 2 1 is "as good as it gets" for p > 0, but as announced, the result 
for p < is not satisfactory. In particular settings, this can be improved. 

Remark 5.3 (p < 0). (i) Assume we know a priori that if there is an 
optimal strategy (tt, k) £ A, then 

(it, k) £ AW := {(tt,k) £ A: X (tt,k) p is of class (D)}. 

In this case we can reduce our optimization problem to the class A^ D \ If 
furthermore I is bounded (which is not a strong assumption when p < 0), the 
class (D) condition in Theorem I5.2f ii) is automatically satisfied for (tt, k) £ 
A( D \ The verification then reduces to checking that (tt , k) £ A^ D \ 

(ii) How can we establish the condition needed for (i)? One possibility 
is to show that L is uniformly bounded away from zero; then the condition 
follows (see the argument in the next proof). Of course, L is not known 
when we try to apply this. However, |26| §4.2] gives verifiable conditions 
for L to be (bounded and) bounded away from zero. They are stated for 
the unconstrained case ^ = W d , but can be used nevertheless: if L Rd is the 
opportunity process corresponding to ^ = M. d , the actual L satisfies L > L Rd 
because the supremum in (|2.3p is taken over a smaller set in the constrained 
case. 

In the situation where I and L _1 are bounded, we can also use the fol- 
lowing result. Note also its use in Remark I3.3f ii) and recall that 1/0 := oo. 

Corollary 5.4. Let p < and let (I, n, k) be a solution of the Bellman 
equation. Let L be the opportunity process and assume that IjL is uniformly 
bounded. Then (tt, k) is optimal and £ = L. 

Proof. Fix arbitrary (tt, k) £ A* E and let X = X(tt,k). The process 
L| (X(tt, k)) p + f U s (k s X s ) fi(ds) is a negative supermartingale by Propo- 
sition [221 hence of class (D). Since J U s (k s X s ) /j,(ds) is decreasing and its 
terminal value is integrable (definition of A^ E ), L^X P is also of class (D). 
The assumption yields that £^X P is of class (D), and then so is Z(tt, k). □ 

As bounded solutions are of special interest in BSDE theory, let us note 
the following consequence. 
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Corollary 5.5. Let p < 0. Under Assumptions \3. il the following are equiv- 
alent: 

(i) L is bounded and bounded away from zero, 

(ii) there exists a unique bounded solution of the Bellman equation, and 
this solution is bounded away from zero. 

One can note that in the setting of [26, §4.2], these conditions are further 
equivalent to a reverse Holder inequality for the market model. 

We give an illustration of Theorem 15.21 also for the case p € (0, 1). Thus 
far, we have considered only the given exponent p and assumed (|2.2p . In 
many situations, there will exist some po E {p, 1) such that, if we consider 
the exponent po instead of p, the utility maximization problem is still finite. 
Note that by Jensen's inequality this is a stronger assumption. We define 
for go > 1 the class of semimartingales I bounded in L qo (P), 

B(<?o) := : sup r ||^ r || L90 (p) < oo}, 
where the supremum ranges over all stopping times r. 

Corollary 5.6. Let p £ (0, 1) and let there be a constant k\ > such that 
D > k\. Assume that the utility maximization problem is finite for some 
Po £ (P> 1) an d let qo > 1 be such that qo > po/(Po — p)- If #, «;) is a 
solution of the Bellman equation (for p) with I G B(go), then t = L and 
(n, k) is optimal. 

Proof. Let I € B(c/o) be a solution, (fr, k) the associated strategy, and X = 
X(fr, k). By Theorem 15.21 and an argument as in the previous proof, it suffices 
to show that £X P is of class (D). Let 5 > 1 be such that 5/qo + dp/po = 1- 
For every stopping time r, Holder's inequality yields 

E[{£ T XP) 5 } = E[{lf) s l qQ {XP°) Sp l po ] < E[l q T °} 5 / qo E[XP°} Sp / po . 

We show that this is bounded uniformly in r; then {£ T Xr : r stopping time} 
is bounded in L S (P) and hence uniformly integrable. Indeed, ^[£r°] is 
bounded by assumption. The set of wealth processes corresponding to admis- 
sible strategies is stable under stopping. Therefore E[Dt^Xt°] < u^ po ^(xo), 
the value function for the utility maximization problem with exponent pq. 
The result follows as Dj- > k\. □ 

Remark 5.7. In [26, Example 4.6] we give a condition which implies that 
the utility maximization problem is finite for all po € (0,1). Conversely, 
given such a po £ (p, 1), one can show that L G B(po/p) if D is uniformly 
bounded from above (see |27[ Corollary 4.2]). 

Example 5.8. We apply our results in an ltd model with bounded mean 
variance tradeoff process together with an existence result for BSDEs. For 
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the case of utility from terminal wealth only, we retrieve (a minor general- 
ization of) the pioneering result of |14[ §3]; the case with intermediate con- 
sumption is new. Let W be an m-dimensional standard Brownian motion 
(m > d) and assume that F is generated by W. We consider 

dRt = b t dt + a t dW t , 

where b is predictable IR^-valued and a is predictable W dxm - valued with 
everywhere full rank; moreover, we consider constraints & satisfying (CI) 
and (C2). We are in the situation of Assumptions 13.31 with dM = a dW and 
A = (<ja T )~ 1 b. The process 9 := c T A is called market price of risk. We 
assume that there are constants k{ > such that 

r T 

< kt < D < k 2 and / \8 S \ 2 ds < k 3 . 

Jo 

The latter condition is called bounded mean-variance tradeoff. Note that 
dQ/dP = £(—\ • M)t = £(—9 • W)t defines a local martingale measure 
for £{R). By |26[ §4.2] the utility maximization problem is finite for all p 
and the opportunity process L is bounded and bounded away from zero. It 
is continuous due to Remark l3.13f i). 

As suggested above, we write the Bellman BSDE for Y := log(L) rather 
than L in this setting. If Y = A Y + (p Y • M + N Y is the Kunita-Watanabe 
decomposition, we write Z := a T (f Y and choose Z 1 - such that Z 1 - • W = N Y 
by Brownian representation. The orthogonality of the decomposition implies 
cr T Z" L = and that Z T Z 1 - = 0. We write 5 = 1 if there is intermediate 
consumption and 5 = otherwise. Then Ito's formula and Corollary 13.121 
(with A t := t) yield the BSDE 

dY = f{Y,Z,Z L )dt + {Z + Z L )dW; Y T = \og{D T ) (5.1) 

with 

f(Y, z, z L ) = \p{\ - p) <% Tv {p{e + z)) + i\e + z\ 2 

+ 5{p - 1)D0 exp ({q - 1)Y) - \(\Z\ 2 + \Z L \ 2 ). 

Here f3 = (1 — p)~ l and q = p/(p— 1); the dependence on (cj, t) is suppressed 
in the notation. Using the orthogonality relations and p(l — p)/3 2 = —q, one 
can check that f(Y, Z, Z L ) = f(Y, Z+Z L , 0) =: f(Y, Z), where Z := Z+Z L . 
As € we have d 2 rT< ^(x) < \x\ 2 . Hence there exist a constant C > and 
an increasing continuous function (j) such that 

\f(y,z)\ <C{\9\ 2 + <P{y) + \~z\ 2 ). 

The following monotonicity property handles the exponential nonlinearity 
caused by the consumption: As p — 1 < and q — 1 < 0, 

-y[f(y,z)-f(0,zj\ <0. 
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Thus we have Briand and Hu's |U Condition (A.l)] after noting that they 
call — / what we call /, and [U Lemma 2] states the existence of a bounded 
solution Y to the BSDE (|5.ip . Let us check that £ := exp(y) is the op- 
portunity process. We define an associated strategy (ft,k) by k := (D/£)@ 
and Proposition 14. 3| then we have a solution (£, ft, k) of the Bellman equa- 
tion in the sense of Definition 14.11 For p < (p G (0,1)), Corollary 15.41 
(Corollary 15. fc>[) yields £ = L and the optimality of (ft, k). In fact, the same 
verification argument applies if we replace ft by any other predictable c €- 
valued tt* such that a 1 tt* G IF v {[3(0 + Z)}; recall from Proposition 14.31 
that 7T* G L(R) holds automatically. To conclude: we have that 

L = exp(y) is the opportunity process 

and the set of optimal strategies equals the set of all (tt*, k) such that 

• k = (D/Lf /i°-a.e., 

• tt* is predictable, ^-valued and a 7 tt* G {j3(6 + Z)} P <g) dt-a.e. 

One can remark that the previous arguments show Y' = log(L) whenever 
Y' is a solution of the BSDE (|5.ip which is uniformly bounded from above. 
Hence we have proved uniqueness for (|5.ip in this class of solutions, which is 
not immediate from BSDE theory. One can also note that, in contrast to |14j . 
we did not use the theory of BMO martingales in this example. Finally, we 
remark that the existence of an optimal strategy can also be obtained by 
convex duality, under the additional assumption that ^€ is convex. 

We close this section with a formula intended for future applications. 

Remark 5.9. Let (£, ft, k) be a solution of the Bellman equation. Sometimes 
exponential formulas can be used to verify that Z(ft, k) is of class (D). 

Let h be a predictable cut-off function such that ft T h(x) is bounded, e.g., 
h(x) = ^l{| a .|<i}n{|fi- T x|<i}' an d define ^ to be the local martingale 

IZ 1 -M e +pft-R c + pft T h(x) * (fi R - v R ) + p(x'/£_)ft T h(x) * (fi R ' £ - v R ' £ ) 
+ (1 + x' /£-){(! + ft T x) p - l-pft T h(x)} * (v R ' £ - is R ' e ). 

Then £(^) > 0, and if £(^) is of class (D), then Z(ft, k) is also of class (D). 

Proof. Let Z = Z(ft, k). By a calculation as in the proof of Lemma [3.41 and 
the local martingale condition from Proposition 14.71 (|X^) _1 • Z = £^ • \P. 
Hence Z = Zq£(^) in the case without intermediate consumption. For 
the general case, we have seen in the proof of Corollary 15.41 that Z is of 
class (D) whenever £^X P is. Writing the definition of k as k v ~ x = £^/D 
fi-a.e., we have £\X? = Z - f hi-±X p d/x = (t-^X p ) •(*-«;•//), hence 

£^X P = Zq8(^ — k • /J,) = Zq£(^>) exp(— k • fj). It remains to note that 
exp ( — k •//)<!. □ 
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5.2 Verification via Deflator 



The goal of this section is a verification theorem which involves only the can- 
didate for the optimal strategy and holds for general semimartingale models. 
Our plan is as follows. Let {£, ft, k) be a solution of the Bellman equation 
and assume for the moment that ^ is convex. As the concave function g e 
has a maximum at tt, the directional derivatives at tt in all directions should 
be nonpositive (if they can be defined). A calculation will show that, at the 
level of processes, this yields a supermartingale property which is well known 
from duality theory and allows for verification. In the case of non-convex 
constraints, the directional derivatives need not be defined in any sense. Nev- 
ertheless, the formally corresponding quantities yield the expected result. To 
make the first order conditions necessary, we later specialize to convex % '. As 
in the previous section, we first state a basic result; it is essentially classical. 

Lemma 5.10. Let i he any positive cadlag semimartingale with £t = Dt- 
Suppose there exists (tt,k) £ A with k = (D/£)@ and let X := X(fr,k). 
Assume Y := £X P has the property that for all (tt, k) £ A, 

T(tv,k) :=X(tt,k)Y + J K s X s (n, k)Y s fj,(ds) 

is a supermartingale. Then T(fc, k) is a martingale if and only if (|2.2p holds 
and (tt, k) is optimal and t = L. 

Proof. "=>": Let (tt,k) € A and denote c = kX(tt,k) and c = kX. Note 
the partial derivative dU{c) = DkP^XP- 1 = IX?~ X = Y. Concavity of U 
implies U(c) — U(c) < dU(c)(c — c) = Y(c — c), hence 
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Let r(7r, k) be a martingale; then Tq(it,k) = , k) and the supermartin- 
gale property imply that the last line is nonpositive. As (tt, k) was arbitrary, 
(tt, k) is optimal with expected utility E [ f Q U s (c s ) /i°(ds)] = E^Ft^, k)] = 
^Tq(tt, k) = ^Xq£q < oo. The rest is as in the proof of Lemma 15.11 □ 

The process Y is a supermartingale deflator in the language of |19) . We 
refer to |26j for the connection of the opportunity process with convex du- 
ality, which in fact suggests Lemma [5.101 Note that unlike Z(it,k) from the 
previous section, r(-7r, k) is positive for all values of p. 

Our next goal is to link the supermartingale property to local first order 
conditions. Let y,y G ffn'tf (we will plug in fc for y). The formal directional 
derivative of g e at y in the direction of y is (y — y) T Vg e (y) = G e (y, y), where, 
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by formal differentiation under the integral sign (cf. (|3.2p ) 



G e (y,y):= (5.2) 
£. (y - y) T (b R + ^ + (p- l)c R y) + [ (y - y) T x'h{x) F R ' e (d(x, x')) 



R d xl 

+ I (£_ + x'){{1 + y T xf-\y - y) T x - (y - y) T h(x)} F R > e (d(x, x')). 

JR d xR 

We take this expression as the definition of G^(y, y) whenever the last integral 
is well defined (the first one is finite by (|4.2|) ). The differentiation cannot be 
justified in general, but see the subsequent section. 

Lemma 5.11. Let y G ^° and y G ^°'* Ci{g e > -oo}. ThenG e (y,y) is well 
defined with values in (—00,00] and G e (-,y) is lower semicontinuous on < ^ ?0 . 

Proof. Writing (y — y) T x = 1 + y T x — (1 + y T x), we can express G e (y, y) as 
£.{y - v) T (b R + ^ + (p~ l)c R y) + [ (y- y) T x'h(x) F R >\d(x,x')) 

v 7 jR d xR 



+ x'] 



1 + y x 



, , , .-,.,,_„ - 1 - (y + (p- m T Kx)}F R ^d(x,x')) 

- f {£-+x'){(l + y T x) p -l-py T h(x)} F R ' e (d(x,x')). 

jR d xR 

The first integral is finite and continuous in y by (|4.2p . The last integral 
above occurs in the definition of g e (y), cf. (|3.2p . and it is finite if g (y) > —00 
and equals +00 otherwise. Finally, consider the second integral above and 
call its integrand -0 = tp(y,y,x,x'). The Taylor expansion 



l+y 1 x 



1 + (y + ip ~ ^)y) Tx + ^ p 2^ (?y + (p ~~ 2)y) T x xT y + °(M 3 ) shows that 

/{|i|+|i'|<l}^ * s we ^ defined and finite. It also shows that given a 
compact K C M. d , there is e > such that J^ x ^ x ^< £ y'>pdF R ^ is continuous 
in y G K (and also in y G K). The details are as in Lemma lA.21 Moreover, 
for y G we have the lower bound ip > (t_ +x'){ — 1 — (y+(p—l)y) T h(x)}, 
which is F^-integrable on {\x\ + \x'\ > e} for any e > 0, again by (|4.2p . 
The result now follows by Fatou's lemma. □ 

We can now connect the local first order conditions for </ and the global 
supermartingale property: it turns out that the formal derivative G deter- 
mines the sign of the drift rate of T (cf. (|5.3p below), which leads to the 
following proposition. Here and in the sequel, we denote X = X(fc,k). 

Proposition 5.12. Let (£,fr,k) be a solution of the Bellman equation and 
(vr, k) G A. Then T{n, «) := £X'' } ~ 1 X{-k, k) + J k s £ s X p s ~ 1 X s {it , k) fi(ds) is a 
supermartingale (local martingale) if and only if G (tv,tt) < (= 0). 
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Proof. Define R = R — (x — h(x)) * p R as in (|2.4p . We abbreviate it := 
(p — 1)tt + 7r and similarly R := (p — l)k + k. We defer to Lemma IC.ll a 
calculation showing that fx£ X_ (tt,k)) • (^^(tt.k)) equals 

+ Tt T x'h( X ) * ^+ (£_ + X'){(1 + 7r T x) I '- 1 (l + 7T T X) - 1 - Tt T h{ X )} * p** . 

Here we use a predictable cut-off function h such that 7t T h(x) is bounded; 
e.g., h{x) = a7l{b|<i}n{|7f T a;|<l}' Since (£,ir,k) is a solution, the drift of £ is 

A £ = -pU*(£_) • n - pg e (Tr) • A = (p- l)£-k • n - pg l {%) • A. 

By Remark 12. 3| T := Y(tt,k) has a well defined drift rate aF with values in 
(—00,00]. From the two formulas above and (|2,4p we deduce 

a T = X p _~ l X{ix, k)_G\it, tt). (5.3) 

Here X^ _1 X(-7t,k)_ > by admissibility. If T is a supermartingale, then 
aF < 0, and the converse holds by Lemma 12.41 in view of T > 0. □ 

We obtain our second verification theorem from Proposition 15.121 and 
Lemma 15.101 

Theorem 5.13. Let (£,-ft,k) be a solution of the Bellman equation. Assume 
that P <g> A-a.e., G e (y,Ti) G [-00, 0] for all y G ^fl^ '*. Then 

T(TT,k) :=£X P + J k s £ s X P p{ds) 

is a local martingale. R is a martingale if and only if (|2,2p holds and (tt, k) 
is optimal and £ = L is the opportunity process. 

If ^ is not convex, one can imagine situations where the directional 
derivative of gr at the maximum is positive — i.e., the assumption on G^(y, tt) 
is sufficient but not necessary. This changes in the subsequent section. 

5.2.1 The Convex-Constrained Case 

We assume in this section that 'rf is convex; then ^ l~l is also convex. Our 
aim is to show that the nonnegativity condition on in Theorem 15.131 is 
automatically satisfied in this case. We start with an elementary but crucial 
observation about "differentiation under the integral sign". 

Lemma 5.14. Consider two distinct points yo and y in M rf and let C = 
{Wo + (1 ~~ v)y '■ — V — !}• Let p be a function on £ x C , where £ is 
some Borel space with measure v, such that x 1— > p(x, y) is v -measurable, 
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J p + (x, •) u{dx) < oo on C, and y \— > p(x,y) is concave. In particular, the 
directional derivative 




exists in ( — 00,00] for all y € C. Let a be another concave function on C. 

Define j(y) := a(y) + J p(x, y) v(dx) and assume that 7(2/0) > ~°° an d 
that 7(2/) = maxc 7 < 00. Then for all y G C , 



and in particular Dy tV p(x, ■) < 00 v{dx)-a.e. 

Proof. Note that 7 is concave, hence we also have 7 > —00 on C. Let v = 

(y - y) and S > 0, then liS+^M = *(y+ev)-a(y) + j p(x,y+ev)-p(x,y) 

By concavity, these quotients increase monotonically as e i 0, in particular 
their limits exist. The left hand side is nonpositive as y is a maximum and 



For completeness, let us mention that if 7(2/0) = — 00, there are examples 
where the left hand side of (|5.4p is —00 but the right hand side is finite; 
we shall deal with this case separately. We deduce the following version of 
Theorem I5.13| as discussed, it involves only the control (fr, k). 

Theorem 5.15. Let (£,jr,k) be a solution of the Bellman equation and as- 
sume that ^ is convex. Then T(tt,k) := £X P + J k s £ s Xs p.{ds) is a local 
martingale. It is a martingale if and only if (|2.2p holds and (fr, k) is optimal 
and i = L. 

Proof. To apply Theorem 15. 13| we have to check that G i (y,Tr) € [— 00, 0] for 
y € ^ fl ^ , °'*. Recall that 7r is a maximizer for c/ and that G e was defined 
by differentiation under the integral sign. Lemma 15.141 yields G i (y,Tr) < 
whenever y £ {g £ > —00}. This ends the proof for p E (0, 1) as gr is then 
finite. If p < 0, the definition of c/ and Remark I A. 71 show that the set 
{g e > —00} contains the set Urjg[o 1) Wffi ^ < ^°) w hich, in turn, is clearly 
dense in ^ fl ^ '*. Hence {(/ > —00} is dense in ^ n < ^ '* and we obtain 
G e (y, 7r) £ [—00, 0] for all y G ^ fl < ?f '* using the lower semicontinuity from 
Lemma 15.111 □ 

Remark 5.16. (i) We note that r(7r,K) = pZ{f,k) if Z is defined as 
in (|4.4p . In particular, Remark 15.91 can be used also for r(7r, k). 

(ii) Muhle-Karbe [24j considers certain one-dimensional (unconstrained) 
affine models and introduces a sufficient optimality condition in the form of 
an algebraic inequality (see |24[ Theorem 4.20(3)]). This condition can be 
seen as a special case of the statement that G L (y, tt) € [—00, 0] for y G < £? '*; 
in particular, we have shown its necessity. 




(5.4) 



monotone convergence yields (|5.4p . 



□ 
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Of course, all our verification results can be seen as a uniqueness result 
for the Bellman equation. As an example, Theorem 15. 151 yields: 

Corollary 5.17. Iflo is convex, there is at most one solution of the Bellman 
equation in the class of solutions (£,tt,k) such that T(n, k) is of class (D). 

Similarly, one can give corollaries for the other results. We close with a 
comment concerning convex duality. 

Remark 5.18. (i) A major insight in |21] was that the "dual domain" for 
utility maximization (here with c € = should be a set of supermartin- 
gales rather than (local) martingales when the price process has jumps. A 
one-period example for log-utility |21| Example 5.1'] showed that the su- 
permartingale solving the dual problem can indeed have nonvanishing drift. 
In that example it is clear that this arises when the budget constraint be- 
comes binding. For general models and log-utility, |11] comments on this 
phenomenon. The calculations of this section yield an instructive "local" 
picture also for power utility. 

Under Assumptions 13 . ll the opportunity process L and the optimal strat- 
egy (-7T, k) solve the Bellman equation. Assume that ^* is convex and let 
X = X(tt,k). Consider Y = LX P , which was the solution to the dual 
problem in |26|. We have shown that Y£(ir • R) is a supermartingale for 
every n 6 A; i.e., Y is a supermartingale deflator. Choosing ir = 0, we see 
that Y is itself a supermartingale, and by (|5.3p its drift rate satisfies 

a ? = xr^O.Tr) = -X^^Vgiff). 

Hence Y is a local martingale if and only if 7r T V<?(7r) = 0. One can say 
that — 7r T V(7(7r) < means that the constraints are binding, whereas in an 
"unconstrained" case the gradient of g would vanish; i.e., Y has nonvanish- 
ing drift rate at a given (u,t) whenever the constraints are binding. Even 
if = M. d , we still have the budget constraint in the maximization of 
g. If in addition R is continuous, < ^ 7 ° = M. d and we are truly in an uncon- 
strained situation. Then Y is a local martingale; indeed, in the setting of 
Corollary 13.121 we calculate 

Y = y £[ - A • M + J- • A L ), y := L Q x p - X . 

Note how N , the martingale part of L orthogonal to R, yields the solution 
to the dual problem. 

(ii) From the proof of Proposition 15 . 1 2l we have that the general formula 
for the local martingale part of Y is 

M Y = X^ 1 • + L_(p - 1)tt ' M R + (p- 1)ttV/i(x) * {fx R ' L - u R ' L ) 

+ (L_ + 0{(1 + T^xf- 1 - 1 - (p - l)7T T h(x)} * {fi R ' L - v R > L )) . 
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This is relevant in the problem of q-optimal equivalent martingale measures; 
cf. Goll and Riischendorf |12| for a general perspective. Let u(xq) < oo, D = 
1, n = 0, ^ = M. d , and assume that the set <dt of equivalent local martingale 
measures for S = £{R) is nonempty. Given q = p/(p — 1) £ (— oo, 0) U (0, 1) 
conjugate to p, Q £ is called q-optimal if q^ 1 (dQ / dP) q ] is finite and 
minimal over If g < 0, i.e., p 6 (0, 1), then u(xq) < oo is equivalent to 
the existence of some Q £ ^# such that E[— q^ 1 (dQ / dP) q ] < oo; moreover, 
Assumptions l3~Tl are satisfied (see Kramkov and Schachermayer |21| I22j). 
Using |21[ Theorem 2.2(iv)] we conclude that 

(a) the q-optimal martingale measure exists if and only if aX = and M Y 
is a true martingale; 

(b) in that case, 1 + y^ 1 M Y is its P-density process. 

This generalizes earlier results of |12| as well as of Grandits [13] ■ Jeanblanc 
et al. |16| and Choulli and Strieker [6]. 



A Proof of Lemma 13.8b A Measurable Maximizing 
Sequence 

The main goal of this appendix is to construct a measurable maximizing 
sequence for the random function g (cf . Lemma 13. 8|) . The entire section is 
under Assumptions 13 . ll Before beginning the proof, we discuss the properties 
of g; recall that 

g(y) :=L_y T (b R + ^ + ^c R y) + / x'y T h{x) F R ' L (d(x, *')) 

v 7 JR d xR 

+ I (L^ + x'){ p -\l+y T x) p -p- 1 -y r h(x)}F R ' L (d(x,x')). 

JR d xR 

(A.l) 

Lemma A.l. L_ + x' is strictly positive F L {dx')-a.e. 
Proof. We have 

(P v L ){L„ + x 1 < 0} = E[1 {L _ +X ,< 0} * 4] 

= ^[l{X_+a;'<Q} * Mr] 



E 



^2 1 {i s <0} 1 {AL 3 ^0} 



which vanishes as L > by Lemma [271 



□ 



Fix (uj,t) and let I := Lt_(u;). Furthermore, let F be any Levy measure 
on M rf+1 which is equivalent to F R ' (uS) and satisfies (|2.5p . Equivalence 
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implies that ^(uj), ^?'*(a;), and JVtiyj) are the same if defined with respect 
to F instead of F R . Given e > 0, let 

If (y) := I (1 + x'){p-\l + y T xf - p' 1 - y T h(x)} F(d(x, x')), 

J {\x\ + \x'\<e} 

I F £ (y) := [ (1 + x'){p-\l + y T xf - p- 1 - y T h(x)} F(d(x, x')), 

J {\x\+\x'\>e} 

so that 

I F {y) :=I F {y) + I F e {y) 

is the last integral in fjA. 1[) when F = F^ ,L {ui). We know from the proof 
of Lemma 13.41 that J fR ' l (y) i s well defined and finite for any ir £ A$ E (of 
course, when p > 0, this is essentially due to the assumption (|2,2p ). For 
general F, I F has the following properties. 

Lemma A. 2. Consider a sequence y n — > y^ in ff . 

(i) For any y € 'if , the integral I F (y) is well defined in IR U {sign(p)oo}. 
(ii) For e < (2sup n |y„|) _1 we have I F {y n ) ->■ lf{Voo)- 
(Hi) If p £ (0,1), I F is l.s.c., that is, liminf„ I F (y n ) > I F (yoo)- 
(iv) If p < 0, I F is u.s.c., that is, limsup n I F (y n ) < I F (yoo)- Moreover, 
y G <*f° \ tf '* implies I F (y) = -oo. 

Proof. The first item follows from the subsequent considerations. 

(ii) We may assume that h is the identity on {|x| < e}; then on this set 
p~ 1 (l + y T x) p — p~ x — y T h(x) =: tfj(z)\ z=y T x , where the function ip is smooth 
on {\z\ < 1/2} C R satisfying 

1){z) = p-\l + zf -p~ 1 -z = ^z 2 + o(|z| 3 ) 

because 1 + z is bounded away from 0. Thus tp(z) = z 2 tp(z) with a function 
if; that is continuous and in particular bounded on {\z\ < 1/2}. 

As a Levy measure, F integrates (\x'\ 2 + \x\ 2 ) on compacts; in particular, 
G(d(x, x')) := \x\ 2 F(d(x, x')) defines a finite measure on {\x\ + \x'\ < e}. 
Hence I F (y) is well defined and finite for \y\ < (2e) _1 , and dominated conver- 
gence shows that I F (y) = f{\ x \ + \ x /\ <£ -}(l + x')ijj(y T x) G(d(x, x')) is continuous 
in y on {\y\ < (26)- 1 }. 

(iii) For |y| bounded by a constant C, the integrand in I F is bounded 
from below by C + for some constant C depending on y only through 
C. We choose e as before. As C + is F-integrable on {\x\ + \x'\ > e} 
by (|2.5p . I F (y) is well defined in KU {oo} and l.s.c. by Fatou's lemma. 

(iv) The first part follows as in (iii), now the integrand is bounded from 
above by C + \x'\. If y € \ Lemma I A. II shows that the integrand 
equals — oo on a set of positive .F-measure. □ 
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Lemma A. 3. The function g is concave. lf^£ is convex, g has at most one 
maximum on n modulo Jf . 

Proof. We first remark that the assertion is not trivial because g need not 
be strictly concave on .yV 1 - , for example, the process Rt = t(l, . . . , 1) T was 
not excluded. 

Note that g is of the form g(y) = Hy + J(y), where Hy = L—y b R + 
y T c RL + J x'y T h(x) F R ' L is linear and J(y) = ^^-L_y J c R y + I pR ' L (y) is 
concave. We may assume that h(x) = xln x \<\\. 

Let yi,y2 £ D be such that (7(2/1) = 5(2/2) = supg =: g* < 00, 
our aim is to show yi — y 2 € <jV. By concavity, g* = g((yi + y 2 )/2)) = 
[g(yi) + g(y 2 )}/2, which implies J({ yi +y 2 )/2)) = [J(y x ) + J(y 2 )]/2 due to 
the linearity of H. Using the definition of J, this shows that J is constant 
on the line segment connecting 2/1 and 2/2- A first consequence is that 2/1 — 2/2 
lies in the set {y : y T c R = 0, F R {x : y T x ^ 0} = 0} and a second is that 
-ffyi = Hy 2 . It remains to show (2/1 — y 2 ) T b R = to have 2/1 — 2/2 G 

Note that F^jx : 2/ T x / 0} = implies F R < L {x : y T h(x) ^ 0} = 0. 
Moreover, y T c R = implies y T c RL = due to the absolute continuity 
(R°' l ,L c ) <C {R c ' 1 ) which follows from the Kunita-Watanabe inequality. 
Therefore, the first consequence above implies f x'(y\ — y 2 ) T h(x) F R ' L = 
and (2/1 — y 2 ) T c RL = 0, and now the second consequence and the definition 
of H yield = H(y 1 - y 2 ) = L_(yi - y 2 ) T b R . Thus (2/1 - y 2 ) T b R = as 
L_ > and this ends the proof. □ 

We can now move toward the main goal of this section. Clearly we need 
some variant of the "Measurable Maximum Theorem" (see, e.g., |Tj 18.19], 
[19| Theorem 9.5], |28| 2K]). We state a version that is tailored to our needs 
and has a simple proof; the technique is used also in Proposition 14.31 

Lemma A. 4. Let 3> be a predictable set-valued process with nonempty com- 
pact values in 2 R . Let f(y) = f(u,t,y) be a proper function on £F with 
values in R U {— 00} such that 

(i) /(</?) is predictable whenever ip is a 2# -valued predictable process, 

(ii) y 1 — ^ f(y) is upper semicontinuous on £F for fixed (uj,t). 

Then there exists a & -valued predictable process tt such that /(tt) = max§ /. 

Proof. We start with the Castaing representation [28, IB] of S>: there exist 
^-valued predictable processes (ip n ) n >i such that {ip n : n > 1} = 3J for each 
(oj,t). By (i), /* := max (! /(p n ) is predictable, and /* = maxg/ by (ii). 
Fix k > 1 and let A n := {/* - f(<p n ) < 1/k}, A n := A n \ (A 1 U • • • U A n _i). 
Define vr fc := £ n VnU», tnen /* - /(f fe ) < 1 / k and G ®- 

It remains to select a cluster point: By compactness, (7r fe )fc>i is bounded 
for each (uj,t), so there is a convergent subsequence along "random indices" 
Tfc. More precisely, there exists a strictly increasing sequence of integer- 
valued predictable processes = {rfc(w,t)} and a predictable process tt* 
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such that linifc 7Tj ' (lo) = vt^(cj) for all See, e.g., the proof of Follmer 

and Schied |IQ] Lemma 1.63]. We have /* = /(vr*) by (ii). □ 

Our random function g satisfies property (i) of Lemma IA.4I because the 
characteristics are predictable (recall the definition |15| II. 1.6]). We also note 
that the intersection of closed predictable processes is predictable [28, 1M]. 
The sign of p is important as it switches the semicontinuity of g; we start 
with the immediate case p < and denote B r (M. d ) = {x G M d : \x\ < r}. 

Proof of Lemma \3. #1 for p < 0. In this case g is u.s.c. on ffnff (Lemma lA.2p . 
Let S>{n) := ?fl?°n B n (R d ). Lemma \KI\ yields a predictable process 
7r n G argmax^( n ) g for each n > 1, and clearly lim n <7(7r n ) = sup^ n ^>o 5. As 
g{TT n ) > g(0) = 0, we have vr™ £ <*f '* by Lemma \K2\ □ 

A.l Measurable Maximizing Sequence for p £ (0,1) 

Fix p G (0, 1). Since the continuity properties of g are not clear, we will use 
an approximating sequence of continuous functions. (See also Appendix [B] 
where an alternative approach is discussed and the continuity is clarified 
under an additional assumption on ^.) We will approximate g using Levy 
measures with enhanced integrability, a method suggested by [19] in a similar 
problem. This preserves monotonicity properties that will be useful to pass 
to the limit. 

All this is not necessary if R is locally bounded, or more generally if F R,L 
satisfies the following condition. We start with fixed (u,t). 

Definition A. 5. Let F be a Levy measure on which is equivalent to 

F ' and satisfies (|2.5p . (i) We say that F is p-suitable if 

J{1 + \x'\){\ + |x|)n {N>1} F{d{x,x')) < 00. 

(ii) The p-suitable approximating sequence for F is the sequence (F n ) n >i of 
Levy measures defined by dF n /dF = f n , where 

f n (x) = l{|a;|<l} + e~' X '' n l{\x\>l}- 

It is easy to see that each F n in (ii) shares the properties of F, while in 
addition being p-suitable because (1 + |x|) p e _ ' a: '/"' is bounded. As the se- 
quence f n is increasing, monotone convergence shows that J VdF n f J V dF 
for any measurable function V > on ]R rf+1 . We denote by g F the function 
which is defined as in (lATTJl but with F R ' L replaced by F. 

Lemma A. 6. If F is p-suitable, g F is real-valued and continuous on < ^ 7 °. 

Proof. Pick y n — > y in The only term in (jA.lft for which continuity 

is not evident, is the integral I F = I F + I F £ , where we choose e as in 
Lemma [A. 2 1 We have I F (y n ) —> I F (y) by that lemma. When F is p-suitable, 
the continuity of I F £ follows from the dominated convergence theorem. □ 
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Remark A. 7. Define the set 

Crn^ )°:= (J r](^n^°). 

Its elements y have the property that 1 +y T x is i ? ^(<ix)-essentially bounded 
away from zero. Indeed, y = r/yo with rj € [0, 1) and F R {y^x > —1} = 0, 
hence 1 + y T x > 1 - 77, F fl -a.e. In particular, n ^°)° C ^°>*. If <if is 
star-shaped with respect to the origin, we also have (ff PI < ^°)° C c t? '. 

We introduce the compact- valued process 3>{r) := ^ n H £> r (R d ). 

Lemma A. 8. Let F be p- suitable. Under (C3), arg max^( r ) g F C <^ 7 °'*. 

More generally, this holds whenever F is a Levy measure equivalent to 
pR,L sa ti s jyi n g (|2,5p and g F is finite-valued. 

Proof. Assume that y £ c €® \ ^°'* is a maximum of g F . Let 77 G (77, 1) be 
as in the definition of (C3) and yo := r\y. By Lemma I5.14| the directional 
derivative Dy^ yo g can be calculated by differentiating under the integral sign. 
For the integrand of L F we have 

Dy, yo {p- 1 (l + y T xr-p- 1 -y T h(x)} = (l- V ){(l+y T xf~ 1 y T x - y T h(x)} . 

But this is infinite on a set of positive measure as y 6 \ ( ^ '* means that 
-F{y T x = —1} > 0, contradicting the last assertion of Lemma 15.141 □ 

Let F be a Levy measure on R rf+1 which is equivalent to F R ' and sat- 
isfies (|2.5p . The crucial step is 

Lemma A. 9. Let (F n ) be the p-suitable approximating sequence for F and 
fixr > 0. For each n, argmax^) g Fn 7^ ; and for any y* € argmax^( r ) g Fn 
it holds that limsup n g F (y^) = sup^/ r ) g F . 

Proof. We first show that 

I Fn (y)^I F (y) for any y € <*f . (A.2) 

Recall that I F "(y) = f(l+x'){p- l (l+y T x)P-p- l -y T h(x)}f n (x) F(d(x, x')), 
where f n is nonnegative and increasing in n. As f n = 1 in a neighbor- 
hood of the origin, we need to consider only I>™ (for e = 1, say). Its 
integrand is bounded below, simultaneously for all n, by a negative con- 
stant times (1 + l^'l), which is F-integrable on the relevant domain. As 
(/„) is increasing, we can apply monotone convergence on the set : 
p _1 (l + y T x) p — p" 1 — y T h(x) > 0} and dominated convergence on the 
complement to deduce (1A.2[) . 
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Existence of y* 6 arg max^( r ) g Fn is clear by compactness of 3>{r) and 
continuity of g Fn (Lemma IA.6|) . Let y € f^(r) be arbitrary. By definition of 
y* and IpO} . 

lim sup y^™^) > lim sup y F ™ (y) = y F (y). 

n n 

We show limsup n g F {Vn) > limsup n y Fn (y*). We can split the integral 
I Fn (y) into a sum of three terms: The integral over < 1} is the same as 
for / , since f n = 1 on this set. We can assume that the cut-off h vanishes 
outside {\x\ < 1}. The second term is then 

/ (l + x')p- 1 (l + y T x) p f n dF, 
J{\x\>l} 

here the integrand is nonnegative and hence increasing in n, for all y; and 
the third term is 

I' (l + x'X-p^UdF, 

J{\x\>l} 

which is decreasing in n but converges to J/u^n^ + x')(—p~ l ) dF. Thus 

9 F {y* n )> 9 Fn {vl)-e n 

with the sequence e n := /rui^i (I + x ')(~P~ 1 )(fn — 1) dF \, 0. Together, we 
conclude sup^ (r) g F > lim sup n g F (yl) > lim sup n c/ Fn (y*) > sup^ (r) g F . □ 

Proof of Lemma \3. 8\ for p G (0,1). Fix r > 0. By Lemma I A. 4 1 we can find 
measurable selectors 7r n,r for argmaxg( r )g F ™; i.e., 7r™' r (u;) plays the role 
of y* in Lemma \K9\ Taking vr n := vr"'™ and noting 9{n) t ^ n 
Lemma IA.9I shows that 7r n are ^ n ^°-valued predictable processes such 
that limsup n g{ir n ) = sup<^ n <^o g P®A-&.e. Lemma [A. 8 1 shows that 7r n takes 
values in If '*. □ 

B Parametrization by Representative Portfolios 

This appendix introduces an equivalent transformation of the model (R, c to) 
with specific properties (Theorem IB.3|) : the main idea is to substitute the 
given assets by wealth processes that represent the investment opportunities 
of the model. While the result is of independent interest, the main conclusion 
in our context is that the approximation technique from Appendix I A . 1 I for the 
case p € (0, 1) can be avoided, at least under slightly stronger assumptions 
on c €: If the utility maximization problem is finite, the corresponding Levy 
measure in the transformed model is p-suitable (cf. Definition I A. 5 P and hence 
the corresponding function g is continuous. This is not only an alternative 
argument to prove Lemma 13.81 In applications, continuity can be useful to 
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construct a maximizer for g (rather than a maximizing sequence) if one does 
not know a priori that there exists an optimal strategy. A static version of 
our construction was carried out for the case of Levy processes in [25 , §4]. 

In this appendix we use the following assumptions on the set-valued 
process of constraints: 

(CI) is predictable. 

(C2) <i is closed. 

(C4) ^€ is star-shaped with respect to the origin: rf€ C ^£ for all rj G [0, 1]. 

Since we already obtained a proof of Lemma [3. 8 1 we do not strive for min- 
imal conditions here. Clearly (C4) implies condition (C3) from Section 12.41 
but its main implication is that we can select a bounded (hence i?-integrable) 
process in the subsequent lemma. The following result is the construction of 
the jth representative portfolio, a portfolio with the property that it invests 
in the jth asset whenever this is feasible. 

Lemma B.l. Fix 1 < j < d and let W = {x 6 M d : x- 7 ^ 0}. There exists 
a bounded predictable n c tf '* -valued process (ft satisfying 

{(fy) = o} = n <*f°>* n H j = $}. 

Proof. Let B x = Bi(R d ) be the closed unit ball and H := H j . Condition 
(C4) implies {<€ n ^°'* n # = 0} = n #i n n H = 0} , hence we may 
substitute by <*f n B 1 . Define the closed sets H k = {x £M d : \x j \ > Ar 1 } 
for k > 1, then (Jfc #fc = Moreover, let f t =?n?°n # fc . This is a 
compact-valued predictable process, so there exists a predictable process 
such that € ^ (hence 0i 7^ 0) on the set A& := 7^ 0} and (ftk = on 
the complement. Define A fc := A& \ (Ai U • • • U h-k-i) an d <P' '■= Yl,k ^k^A k - 
Then |0'| < 1 and = 0} = {<^n^°n# = 0} = {^nf^nff = 0}; the 
second equality uses (C4) and Remark I A. 71 These two facts also show that 
(ft := \(ft> has the same property while in addition being n ^°'*-valued. □ 

Remark B.2. The previous proof also applies if instead of (C4), e.g., the 
diameter of ^ is uniformly bounded and c €® = ff '*. 

If <I> is a cfxd-matrix with columns (fti, . , . , <f>^ £ L(R), the matrix stochas- 
tic integral R = <]? • R is the Revalued process given by i? J = (ftj • R. If 
ift e L($ • i?) is Revalued, then $ip € L(R) and 

^ . ($ . R) = ($-0) . fi. (B.l) 

If ^ is a set-valued process which is predictable, closed and contains the ori- 
gin, then the preimage shares these properties (cf. [28, 1Q]). Convexity 
and star-shape are also preserved. 

We obtain the following model if we sequentially replace the given assets 
by representative portfolios; here Cj denotes the jth unit vector in M. d for 
1 < j < d (i.e., e) = <%). 
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Theorem B.3. There exists a predictable M. dxd -valued uniformly bounded 
process <I> such that the financial market model with returns 

R:=<S>- R 

and constraints 'rf := <&~ lc £ has the following properties: for all 1 < j < d, 

(i) AR J > — 1 (positive prices), 

(ii) ej € 'to H^ '* , where 'to '* = $ _1 ^ >0 '* (entire wealth can be invested in 
each asset), 

(Hi) the model (R^) admits the same wealth processes as (R^). 

Proof. We treat the components one by one. Let j = 1 and let (p = 0(1) 
be as in Lemma IB, II We replace the first asset R 1 by the process (/> • R, or 
equivalently, we replace R by <£> • R, where $ = $(1) is the d x d-matrix 



/0 1 \ 

9 l 



\<P d V 

The new natural constraints are <& -1< ^° and we replace ^ by Q~ lc tf. Note 
that ei € n < «f '*) because $ei = ^ € ^ (~l < ^ 7 °'* by construction. 

We show that for every 'rf fl ^°'*-valued process 7r € £(-R) there exists 
ip predictable such that = tt. In view of (IB.ip . this will imply that the 
new model admits the same wealth processes as the old one. On the set 
{4> l 0} = is invertible} we take ip = $ _1 7r and on the complement we 
choose ip 1 = and ^ = ir 3 for j > 2; this is the same as inverting $ on its 
image. Note that {(f) 1 = 0} C {tt 1 = 0} by the choice of (j). 

We proceed with the second component of the new model in the same 
way, and then continue until the last one. We obtain matrices for 
1 < j < d and set 3> = $(1) • • • <&(<Z). Then $ has the required properties. 
Indeed, the construction and <E>(i)ej = ej for i ^ j imply ej £ ^"^(^n^ '*). 
This is (ii), and (i) is a consequence of (ii). □ 

Coming back to the utility maximization problem, note that property 
(iii) implies that the value functions and the opportunity processes for the 
models (R, 'rf) and (R, coincide up to evanescence; we identify them in 
the sequel. Furthermore, if g denotes the analogue of g in the model (R,^), 
cf. (j A . 1 1) . we have the relation 

g(y)=9@y), 

Finding a maximizer for g is equivalent to finding one for g and if (tt, k) is 
an optimal strategy for (R,^) then (<I?vr, n) is optimal for (R,^). In fact, 
most properties of interest carry over from (R, ff) to (R,^), in particular 
any no-arbitrage property that is defined via the set of admissible (positive) 
wealth processes. 
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Remark B.4. A classical no-arbitrage condition defined in a slightly differ- 
ent way is that there exist a probability measure Q ~ P under which £(R) is 
a cr-mar ting ale; cf. Delbaen and Schachermayer [9]. In this case, £(R) is even 
a local martingale under Q, as it is a a- martingale with positive components. 

Property (ii) from Theorem IB. 31 is useful to apply the following result. 

Lemma B.5. Let p G (0, 1) and assume ej G ^ l~l ^°'* for 1 < j < d. Then 
u{xq) < oo implies that F R,L is p-suitable. If, in addition, there exists a 
constant k\ such that D > k\ > 0, it follows that /ru^-n. \x\ p F {dx) < oo. 

Proof. As p > and u(xq) < oo, L is well defined and L, L_ > by 
Section 12.21 No further properties were used to establish Lemma 13. 4| whose 
formula shows that g(ir) is finite P ® ^4-a.e. for all it G A = A* E ■ In 
particular, from the definition of g, it follows that J (L_+x'){p _1 (l-|-7r T x) p — 
p^ 1 — 7r T /i(x)} F R,L {d{x, x 1 )) is finite. If D > fci, |26| Lemma 3.5] shows 
that L>ki, hence L_ +x' > &i F L (dx')-a.e. and / {p' 1 (1 + n T x) p - p^ 1 - 
7r T /i(x)} F R (dx) < oo. We choose 7r = ej (and k arbitrary) for 1 < j < d to 
deduce the result. □ 

In general, the condition u(xq) < oo does not imply any properties of R; 
for instance, in the trivial cases ^ = {0} or < ?^ '* = {0}. The transformation 
changes the geometry of ^ and such that Theorem IB.3( ii) holds, and 
then the situation is different. 

Corollary B.6. Let p G (0,1) and u(xq) < oo. In the model (R,^) of 
Theorem\BJl F R > L is p-suitable and hence g is continuous. 

Therefore, to prove Lemma 13.81 under (C4), we may substitute (R,^) 
by (R, ff) and avoid the use of p-suitable approximating sequences. In some 
cases, Lemma [B . 5 1 applies directly in {R,^). In particular, if the asset prices 
are strictly positive {/S.R 3 > — 1 for 1 < j < d), then the positive orthant of 
M. d is contained in ^ 7 °'* and the condition of Lemma lB.51 is satisfied as soon 
as ej G for 1 < j < d. 

C Omitted Calculation 

This appendix contains a calculation which was omitted in the proof of 
Proposition 15.121 

Lemma C.l. Let (i,fr,k) be a solution of the Bellman equation, (tt,k) G A, 
X := X(ir, k) and X := X(tt, k) . Define R = R— (x — h(x)) * /j R as well as 
tt := (p — 1)tt + 7r and R := (p — l)k + k. Then £ := £X P ~ 1 X satisfies 

(x^X-Y 1 -t = 

t - £ + *-tt • R - l-R • n + £-{p - 1) (^vr + tt) T c r tt • A + vr T c Re • A 

+ Tt T x'h( X ) * H R > e + (£- + X'){(1 + TT T X) P '\1 + TT T X) - 1 - 7T T h{ X )} * ^ . 
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Proof. We may assume xq = 1. This calculation is similar to the one in the 

proof of Lemma [3. 4 1 and therefore we shall be brief. By Ito's formula we have 
XP-1 = S (q for 

£ = (p - 1)(tt • R - k • n) + (p ~ 1) 2 (p ~ 2) 7r T c fl 7r • 4 
+ {(1 + TfTxf- 1 - 1 - (p - l)vr T x} * /A 

Thus A*- 1 A" = £ (C + 7T • 22 - k ' n + [Ctt • 22]) =: with 
[22,C] = [22 c ,C c ] + E AjRA ^ 

= (j? — 1)C R TT • A + (p - 1)7T T XX * fl R 
+ x{(l + T^xf' 1 - 1 - 7T T x} * H R 

and recombining the terms yields 

& = ff' R-R' (l+fy- 1)(2^7T + 7r) T C jR 7T • A 
+ {(1 + ^ T X) P_1 (1 + 7T T X) - 1 - 7f T x} * fJ, R . 

Then (X P_1 X_) _1 • f = £ - 4 + * * + [£, where 

= 7f T C^ • A + TT^Vx * //^ 

+ X'{{1 + 7T T a?) p - 1 (l + TT T X) - 1 - 7f T x} * {I*'*- 

We arrive at 

(^- 1 x_)~ 1 -e = 

£ — £o + i—Tr * R — £-R * /j, + £—(p — l)(^7f + vr) T c- R 7r • A + tt t c^ • A 

+ TtVx * ^ + (€_ + X){(1 + ^Xf-^l + ^ T X) - 1 - 7T T X} * 

The result follows by writing x = h(x) + x — h(x). □ 
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